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ABSTRACT 

Fifteen literacy programs, structured as partnerships 
between Job Training Partnership Act (JTPA) Service Delivery Areas 
(SDAs) in Texas and nonprofit literacy councils, were reviewed. 
Interviews were conducted with students, tutors and instructors, 
program directors and other staff, and partners to study program 
effectiveness in establishing partnerships and in providing literacy 
services. Three factors were identified that enabled a program to 
achieve an effective beginning: filling an identified need within 
existing literacy services, using resources outside of the program 
partnership for help and support, and organizing the partnership 
agreement toward a common goal. Funding did not run smoothly. Some 
programs attempted to meet original goals in a shortened time frame; 
all programs experienced a break in services between grant cycles. 
The partner relationship was strongest when partners worked together 
in roles extending beyond referral. From the interviews, 10 
characteristics describing successful partners developed. Programs 
offered a multitude of literacy services; staff were predominantly 
volunteers with little training in adult education. JTPA eligibility 
determination required extensive documentation, and intake assessment 
instruments were uneven in their capacity to determine particip^nts * 
abilities. *^Word of mouth** was most successful in encouraging 
enrollment. A model of an effective partnership program was 
developed. Four areas were targeted for recommended changes: grant 
application process, training, partnerships, and pmgram delivery. 
(Interview schedules are appended.) (YLB) 
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Executive Summary 



From the interviews, 
ten characteristics 
describing successful 
partners developed. 



Beginning in 1989, the Texas Department of Commerce, through the Texas 
Literacy Council, has solicited proposals for literacy programs to be funded 
through the Job Training Partnership Act (JTPA), Tide HA, 8% Funds. These Ht- 
eracy programs, structured as parmerships between JTPA Service Etelivery Areas 
in Texas and local nonprofit literacy councils, ar^ intended to serve JTPA-eligi- 
ble persons identified as educationally disadvantaged. 

In Febmary 1992, the Texas Literacy CouncU contracted with the Texas Cen- 
ter for Adult Literacy and Learning (TCALL) to review the fifteen programs 
which received grants during the 1991-92 program year, and to report on their ef- 
fectiveness in establishing partnerships and in providing literacy services to an 
identified population of participants. A qualitative research method was chosen 
as most appropriate for studying the substantially different programs across the 
state because no data were available to indicate how the programs were orga- 
nized or being implemented. The report of the findings provides a perspective on 
the partnership programs from the exp)erience of those directly mvolved in those 
programs. 

Three factors enable a program to achieve an effective beginning: 1) filling 
an identified need within existing literacy services; 2) utilizing resources outside 
of the program partnership for help and support; and 3) organizing the partner- 
ship agreement toward a common goal. Funding of the programs does not run 
smoothly, with some programs attempting to meet original goals in a shortened 
time frame and all programs experiencing a break in services between grant cy- 
cles. The linkage between the business community and the programs is often 
weak, even when the partnership structure wiLhin the program is strong. 

The strength of the partner relationship is strongest when the Private Industry 
Council, the nonprofit literacy council, at least one formal education partner, and 
at least one social service agency work together in roles which extend beyond re- 
ferral. From the interviews, ten characteristics describing successful partners de- 
veloped. These characteristics define the partnership as a collaboration and co- 
operation process which supports the delivery of literacy services. 

Programs offer a multitude of literacy services, from one-on-one tutoring to 
group instruction and computer centers, with a continuum from the standardized 
LVA or Laubach curriculum to site-specific curricula. English-as-a-second-lan- 
guage, family literacy, and special population programs are included at a few 
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sites. Staff in the programs are predominantly volunteer, with little training in 
adult education. The staff exhibit a high level of caring and commitiyient which 
enables programs to achieve their goals. 

The intake process involving the JTPA eligibility ^plication, and the assess- 
ment of the participants* skills at entry are fraught with problems. Eligibility de- 
termination requires extensive documentation from participants unfamiliar with 
the required paperworic. Assessment instruments are imeven in their capacity to 
determine students' abilities. 

Participants are recruited for the programs through the assistance of social 
service agency referrals, but often "word-of-mouth" is most successful in encour- 
aging participants to enroll in the program. Participants seek learning in order to 
improve their chances for becoming employed and to assist their children's learn- 
ing. The program's impact on participants often extends beyond job skills to 
building of self-confidence and life skills. Child care and transportation are the 
primary barriers to entr>' and continuance in the program for participants across 
the state, although programs endeavor to solve those problems. 

Three areas arc targeted for recommended changes. The grant application 
process can benefit from minor strategic revisions to the RFP and from woilc to- 
wards closing the funding gap. Both partnerships and program delivery can be 
strengthened with a planned training approach at state, regional, and local levels. 
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Introduction 



The evaluator^s 
responsibility is to 
people, not things. 



"Evaluation" is a concept which usually generates feelings of negativity by 
those individuals being evaluated, particularly if an external evaluator is being 
utilized. Because of mistakes, misunderstandings, and sometimes improper atti- 
tudes about the role of the evaluator, the image suggested by Maanen (1979, p. 
1 1) of an external evaluator is sometimes warranted, "... a steely-eyed 'efficiency 
expert* who marches semi-annually into program settings to disrupt the estab- 
lished enterprise and cast a disparaging shadow over the efforts of a hardwoildng 
staff." 

However, the evaluator must remember why evaluations are important-the 
improvement of programmatic or organizational activities. The evaluator's re- 
sponsibility is to people, not things. Therefore, since there are many audiences 
involved in an evaluation-participants, teachers, administrators, funding agen- 
cics-che needs of all must be considered. This perception agrees with Strake 
(1991) who is inclined to let program stakeholders influence the purpose and, to 
some extent, the conduct of the evaluation process, preferring to believe that 
evaluation can provide a service and become useful to the diri'erent audiences in- 
volved. 

Therefore, the staff of this evaluation project have addressed various audi- 
ences, both directly and indirectly, through the findings in this report. No at- 
tempt was made to criticize program staffs, either by individuals or groups. 
However, when possible, exemplary practices are identified by program, not only 
to call attention to those activities, but also to guide the development of the rec- 
ommendations which are found at the end of the report. 

The Job Training Partnership Act (JTPA), created in 1982, contains a major 
goal: To prepare economically disadvantaged (below relative poverty level) 
youth and adults for entry into the labor force. As a part of that goal, fiinds are 
provided under Title II, Part A, for basic literacy skill development. In Texas, in 
1992, there were 15 sites which had grants from the Texas Literacy Council 
(TLC), Texas Department of Commerce, to initiate and develop partnerships be- 
tween the local JTPA program and a community-based literacy organization to 
provide those basic literacy skills needed by adults in the community. These 
grants were initially awarded in 1989 and, in January 1992, discussions were be- 
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gun with staff ai the Texas Center for Adult Literacy and Learning (TCALL) to 
develop a proposal to evaluate those partnership programs. 

When the staff of the TLC and staff of the TCALL began discussing this 
project, the primary focus was upon (1) learning what was happening in the pro- 
grams funded through partnership grants under the JTPA in Texas, and (2) deter- 
mining how they could be improved. Since no previous evaluation of this kind 
had been conducted, the two groups considered the potential impact which might 
be obtained within the constraints of time and costs available to the staff. This 
evaluation was then designed to address the need for descriptive information on 
these programs as outlined by the TLC. 

In this report we offer an in-depth description of the JTPA literacy partner- 
ship programs from the various perspectives of all involved-directors, partners, 
instructors, students. It is as if we were trying to describe what was going on in- 
side a house by looking through several different windows. It is our belief that 
such a multidimensional description provides the most accurate assessment of 
how these programs function. 

This report summarizes our findings regarding what contributes towards ef- 
fective partnership programs. Additionally, we make a series of recommenda- 
tions based on those findings. It is our hope that this report will benefit this liter- 
acy effort and contribute to the increased effectiveness of these programs across 
the state of Texas. 



Partnering for Literacy 



Description Of Program Sites 



The evaluation team visited 15 sites around the state (see Figure #1). The 
following information w'll provide a brief overview and a description of the indi- 
vidual site activities. In developing the Description of Program Sites, we started 
with ihe information provided in the proposals and then supplemented those data 
with infonnation we collected in the field through our interviews. The sites are 
presented alphabetically according to the grant recipient name provided in the 
proposals. 

This information is provided so that the reader will have some idea of the va- 
riety of services available across the state. It provides one indication of the rea- 
son why it is so difficult to compare sites. Some of the sites possess a great deal 
of experience and have a broad network of resources from which to draw, while 
others are initiating literacy efforts for the first time this proposal year and could 
benefit from a regional or statewide support network. 
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Partnership 
Site Locations 



Nortex Regional 
Planning Commission 



North Central 
Texas COG 



City of Dallas and the 
Balance of Dallas County 



South Rains Rural 
Service Delivery Area 



Upper Rio Grande 
PIC 



Centra] Texas 
COG 



City of San Antonio 




Rural Coastal Bend 
HC 



Cameron Coimty 
PIC 



Ark-TexCOG 



East Texas Service 
Delivery Area 



Heart of Texas 
COG 



Harris County 
HC 



Golden Cieeoent 
PIC 

Corpus Chrifi?ti and 
Nueces County Workforce 
Development Corporation 



Figure 1 
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ARK-TEX COUNCIL OF GOVERNMENTS 

RO, Box 5307 
Texarkana. Texas 75505 

Instructional site(s) 

• Tutors and students decide on a convenient location 

• Northeast Texas Community College 

Participating partners 

• Ark -Tex Council of Governments 

• Bowie/Miller Counties Literacy Council 

• Northeast Texas Community College 

Descriptjon of program activities 

Because of the distance (approximately 60 miles) between tl-ie two trainingi^ 
locations, the partners operate independently. Both partners are responsible for 
their own recruiting, advertising, assessing and teaching. Local JTPA offices 
were assigned the responsibility of participant intake. 

Description of predominant teaching method(s) 

At the Bowie/Miller Literacy Council, the teaching method used is one -on- 
one tutoring, while the Northeast Texas Community College uses computer-as- 
sisted instruction. 

The current program is in its first year of consecutive funding. 
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CAMERON COUNTY PRIVATE INDUSTRY COUNCIL 

285 Kings Highway 
Brownsville, Texas 78521 

Instructional site(s) 

• Community centers 

• Brownsville Adult Literacy Center 

Participating partners 

• Cameron County Private Industry Council 

• Amulfo Oliveira Memorial Library 

• Cameron County Housing Authority 

• Texas Department of Human Services 

• Brownsville Housing Authority 

• Christ the King Church, Brownsville 

• Brownsville Adult Literacy Council 

Description of program activities 

The PIC administers the grant and certifies participants who r e referred by 
ihc Department of Human Services (DHS) and the Brownsville Adult Literacy 
Center. DHS identifies welfare recipients and handles case management. The 
Brownsville Housing Authority and Christ the King Church both provide class- 
room space. The Brownsville Adult Literacy Center conducts pretesting and 
hires teachers. The PIC also provides transportation and child care. 

Description of predominant teaching method(s) 

• Group instruction 

• One- on-one instruction 

The current program is in its second year of consecutive funding. 
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CENTRAL TEXAS COUNCIL OF GOVERNMENTS 

RO. Box 729 
Bellon. Texas 76513 

Instructional site(s) 

No formal training location is associated with this grant program. 

Participating partners 

• Central Texas Council of Governments 

• Central Texas College-KNCT 

• Belton Literacy Council 

• Greater Killeen Literacy Council 

• Temple Literacy Council (Gatesville) 

• Windham School System 

• Central Texas Adult Education Cooperative 

• Florence Public Library 

• Haricer Heights Public Library 

• Casey Memorial Public Library 

• Gatesville Public Library 

• American Education Complex Systems Library 

• Copperas Cove Public Library 

Description of program activities 

KNCT develops the curriculum for this program. KNCT has also taken on 
the responsibilities of advertisement, recruimient, and participant assessment. As 
a contribution to the program, the other partners are asked to refer participants to 
KNCT. Participant intake is handled by the staff at the JTPA offices in Belton. 
Killeen, and Temple. 

Description of predominant teaching method(s) 

Instruction centers around the whole language method utilizing video-based 
curriculum which is produced by the public television station at Central Texas 
College (KNCT). The program is broadcast throughout the Killeen viewing area. 

The current program is in its first year of consecutive funding. 
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CITY OF DALLAS AND THE BALANCE OF DALLAS 
COUNTY PRIVATE INDUSTRY COUNCIL 

3625 North Hall #900 
Dallas, Texas 75219 

Instructional sitc(s) 

• Deaf Action Center 
Participaling partners 

• City of Dallas and the Balance of Dallas County PIC 

• Deaf Action Center 

• Dallas County Adult Literacy Council 

Description of program activities 

Onc-on-one and group tutoring in sign language is supported by computers 
and videotapes for visual learning. 

Description of predominant teaching method(s) 

The curriculum v^'hich is developed specifically for this project teaches the 
concept of words as language first since deaf adults communicate with sign lan- 
guage and think in symbols. They then move into reading instruction. 



The current program is in its first year of funding. 



Partnering for Literacy 



CORPUS CHRISTI-NUECES COUNTY WORKFORCE 
DEVELOPMENT CORPORATION 

5110 Wilkinson Drive 
Corpus Christi, Texas 78415 

Inslruclional sile(s) 

• Del Mar College 
Participating partners 

• Corpus Christi-Nueces County Workforce Development Corporation 

• Corpus Christi Literacy Council 

• Del Mar College 

• Corpus Christi Public Libraries 

• Corpus Christi Housing Authority 

Description of program activities 

WIC (the PIC) is responsible for intake and eligibility. The program is ad- 
ministered by the literacy council. All partners share responsibility of referral. 

Description of predominant teaching method(s) 

Formal classes and computer-assisted instruction. 

The current program is in its third year of funding. 



Partnering for Literacy 



CITY OF SAN ANTONIO 
(DEPT. OF COMMUNITY INITIATIVES) 

RO. Box 839966 

San Antonio, Texas 78283 

Instructional silc(s) 

(Proposed) 

• San Antonio ISD, Bowden Elementary 

• Harlandale ISD, Adams Elementary 

• Edgcwood ISD, Stafford Elementary 

Participating partners 

• Communities in Schools, San Antonio, Inc. 

• Edgcwood ISD 

• Harlandale ISD 

• San Antonio ISD 

• Education Service Center, Region 20 

• St. Mary's University 

• San Antonio Public Librarj' 

Description of program activities 

Had noi begun at the time of the site visit, April 1992. 
Description of predominant teaching methods 

Had not begun at the time of the site visit, April 1992. 
The current program is in its first year of consecutive funding. 
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EAST TEXAS SERVICE DELIVERY AREA 

3800 Stone Road 
Kilgore, Texas 75662 

Instructional site(s) 

• Trinity Valley Community College 

• Junior High School and Libraries in Marshall 

Participating partners 

• Private Industry Council-East Texas SDA 

• Athens Literacy Council 

• Trinity Valley Community College (ABE Center) 

• Jobs, Training and Service, Inc. 

• East Texas Employment and Training, Inc. 

• Marshall/Harrison County-Literacy Council, Inc. 

Description of program activities 

One-on-one tutoring, with computers available as students move on to the 
JTS lab in Marshall. This program depends primarily on volunteer tutors. A 
computer learning lab is in Athens. 

Description of predominant teaching method(s) 

LVA, with additional purchased materials available for tutor use. 

The current program is in its second year of funding. 
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GOLDEN CRESCENT PRIVATE INDUSTRY COUNCIL 

2401 Houston Highway 
Victoria, Texas 77901 

Instructional site(s) 

• Victoria Adult Literacy Council 
Participating partners 

• Victoria College 

• Victoria Adult Literacy Council 

Description of program activities 

PIC is fiscal agent and handles recruitment, intake, certification, case man- 
agement, and follow-up. The adult literacy council trains the tutors, who in turn 
instruct participants. The literacy council is also responsible for record-keeping. 
A literacy coordinator makes sure that everything runs smoothly. 

Description of predominant teaching methcd(s) 

• Computer-assisted instruction 

• Onc-on-one instruction 

The current program is in iLs second year of consecutive funding. 
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HARRIS COUNTY PRIVATE INDUSTRY COUNCIL 

1001 Preston. 9th floor 
Houston. Texas 77002 

Instructional site(s) 

• High Meadow Library 

• South Houston Library 

• Woodfonest Library 

Participating partners 

• Harris County Library System 

• Houston READ Commission 

Description of program activities 

The PIC is responsible for participant intake and eligibility while the READ 
commission controls the day-to-day activities of the program. The library system 
provides the instructional facilities. 

Description of predominant teaching method(s) 

Small group instruction. 

The current program is in its second year of consecutive ftuiding. 
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HEART OF TEXAS COUNCIL OF GOVERNMENTS 

300 Franklin Avenue 
Waco, Texas 76701 

Insiruciional siie(s) 

• Schools in Elm Mott and Hillsboro 

Participating partners 

• Heart of Texas Council of Governments 

• Region 12 Educational Sen/ice Center 

• McLennan Community College 

• Mental Health Association 

• Texas Department of Human Services 

• Waco-McLennan County Library 

• Equal Opportunity Advancement Corporation 

• Hispanics for Education 

• Hillsboro ISD 
. Hill College 

• Hillsboro City Librar>^ 

• Center for Adult Learning at Baylor University 

• Texas State Technical College 

• McLennan County Youth Collaboration 

Desciiption of program activities 

The COG is responsible for recruitment, referral, intake, eligibility, assess- 
ment, and other support services. They also provide intake on-site at Elm Mott. 
The partners in Hillsboro and Elm Mott provide instruction. 

Description of predominant teaching meihod(s) 

• Group instruction 

• One-on-one instruction 

The current program is in its third year of consecutive funding. 
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NORTEX REGIONAL PLANNING COMMISSION 

2101 Kemp Boulevard 
Wichita FaUs, Texas 76309 

Insimciional site(s) 

• Work Services Corporation (day) 

• Washington School (evening) 

• Lamar School 

Participating partners 

• Nortex Regional Planning Commission 
•JTPA 

• Wichita Adult Literacy Council 

• Work Services Corporation 

• Region 9 Education Service Center 

Description of program activities 

One-on-one tutoring with computers, plus group work at all locations. Fami- 
ly literacy component is in place at evening sites. In-service tutor training in cur- 
riculum is on-going. 

Description of predominant teaching method used 

Tutors are either LVA or Laubach trained and are working on newly devel- 
oped curriculum. Attempts are being made to incorporate work skills and group 
dynamics into the curriculum. A paid instructor also coordinates and modifies 
materials and makes them available for tutor use. 

The current program is in its first year of funding. 
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NORTH CENTRAL TEXAS COUNCIL OF GOVERNMENTS 

P.O. Drawer COG 
Arlington, Texas 76005 

Insiruciional siie(s) 

•LVA 

• Johnson County Jail 

• Adult Education Cooperative Office 

Participating partners 

• North Central Texas Council of Governments 

• Qebume ISD (Adult Education Cooperative) 

• Johnson County Law Enforcement Center 

• Palo Pinto Community Service Corporation 

• Johnson Community Supervision and Corrections 

• Texas Rehabilitation Commission 

• LVA/Clcbumc 

• Jolinson and Somervell Counties Community Supervision and Corrections 

Description of program activities 

Students at levels 0-4 are provided day and evening instruction at the LVA 
site, including one-on-one tutoring and computer-assisted instruction. A program 
is offered at the jail in evenings with computer-assisted instruction offered to lev- 
els above grade 4. There is a day program offered for individually paced group 
work. 

Description of predominant teaching method(s) 

Tutors at jail site combine Laubach with Steck-Vaughn materials. 
The current program is in its first year of funding. 
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RURAL COASTAL BEND PRIVATE INDUSTRY COUNCIL 

P.O. Box 1780 
Beeville, Texas 78104 

Instniclional sile(s) 

• Alice Public Library 

• LVA office 

• Center for Continuing Education 
Participating partners 

• Rural Coastal Bend Private Industry Council 

• Bee County Adult Literacy, Beeville 

• Literacy Volunteers of America, George West, Live Oak County 

• Texas A & I University, Kingsville, Center for Continuing Education 

• Adult Literacy Program, Alice Public Library 

Description of program activity 

The PIC is responsible for recruitment and referrals, certification, assess- 
ment, and intake, while the partners provide instruction. 

Description of predominant teaching method(s) 

• Group instruction 

• One-on-one instruction 

• Computer-assisted instruction 

The current program is in its third year of consecutive funding. 
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SOUTH PLAINS RURAL SERVICE DELIVERY AREA 

P.O. Box 610 (411 Austin Street) 
Levelland, Texas 79336 

Instructional site(s) 

• Computer Center, Littlefield 

• Laubach Center, Levelland ISD 

Participating partners 

• South Plains Rural Service Delivery Area 

• Carver Literacy Council 

• Lamb County Librarj' 

• Lamb County Literacy Council 

• Texas Employment Commission 

• Hockley County Library 

Description of program activities 

Eligible participants arc assigned to either the Lamb County Literacy Council 
for computer-assisted instmction or the Carver Literacy Council for tutoring. 

Description of predominant teaching method(s) 

• Computer-assisted instruction 

• Onc-on-one instmction 

The current program is in its second year of consecutive funding. 
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UPPER RIO GRANDE PRIVATE INDUSTRY COUNCIL 

1155 Westmoreland, #235 
El Paso, Texas 79925 

Instructional site(s) 

• Schools 

• Library 

^ Partners (e.g., BRAVO, El Pan) 

Participating partners 

• Upper Rio Grande Private Industry Council 

• El Pan 

• El Paso Center of the Deaf 

• El Paso Public Library 

• Literacy Coalition of El Paso 

• El Paso Community College 

• Texas Department of Human Services 

• Project BRAVO 

• El Paso ISD 

• Ysleta ISD 

• Association for Adults and Children with Learning Disabilities 

• Even Start 

• Socorro ABE Cooperative 

• Laubach Literacy Council of El Paso 

Description of program activities 

The PIC is the leader in the partnership and performs case management, fis- 
cal responsibilities, administration, certification of eligibility, recruitment, sup- 
port services, intake, assessment, and referrals. The partners provide training and 
other services as needed. 

Description of predominant teaching method(s) 

• Classroom instruction 

• Computer-assisted instruction 

• One-on-one instruction 

The current program is in its third year of consecutive funding. 
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Methodology 



The object of this study, in its broadest terms, was to understand how these 
partnership programs function in order to develop a model of effectiveness. Be- 
cause the focus was on process rather than outcome, and because that process in- 
volved social interaction, it was appropriate to use a qualitative research design. 
Qualitative research is descriptive in character and is concerned with understand- 
ing the meaning that people give to their experience (Merriam, 1989), In this 
study that meant that our goal was to understand the subjective experience of the 
people involved in these partnerships-students, instructors, program directors, 
and partners-so that we could gain a composite view of how these programs 
function. In a sense we tried to get inside their experience so that we could see 
the programs from their various perspectives. 

The primar>' means of collecting data in qualitative research is through inter- 
views. For this study each of the 15 partnership grant programs was visited by 
one of the five researchers on the team. These site visits were arranged in ad- 
vance with program directors, who were asked to provide information about the 
program and to schedule interviews with various people involved in that pro- 
gram. At every site the researcher conducted, on average, 10 interviews, speak- 
ing with selected current students, tutors and instructors, program directors and 
other staff, and partners. Telephone interviews were later conducted with several 
students who had completed the program an A^ith some who had dropped out of 
the program. In addition, the administrators uf four programs that had been of- 
fered funding but had declined it were also interviewed. [A copy of the interview 
questions for each of these groups is given in the Appendix.] This was a purpo- 
sive rather than a random sample of people interviewed. In qualitative research 
there is no need for a random sample; instead there is a need to find people who 
can cleariy articulate their experience. For that reason we asked the program di- 
rectors to select those students, staff, and parsers who in their judgment could 
give us the greatest amount of information. Because we were not evaluating in- 
dividual programs but rather seeking to understand what contributes to the effec- 
tiveness of this type of program overall, this approach to sample selection 
seemed appropriate. However, at several sites the team member interviewed stu- 
dents in addition to those selected by the program director and responses of all 
were compared for reporting purposes. 



Qualitative research 
seeks to understand the 
meaning people give to 
their experience. 
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Themes that 
emerge from the data 
contribute directly to 
the findings of the 
study. 



All of the interviews were tape recorded and subsequently transcribed. Once 
all the interview transcripts were completed, data analysis began. This process 
had several stages. We began by reading several interviews in one group of par- 
ticipants-for example, current students. As we read each interview, we identified 
the basic categories of information that were being presented, and we coded the 
transcripts accordingly. For example, in one portion of the interviews the stu- 
dents would discuss what they expected to gain from being in the program, and 
we coded this information "anticipated benefit"; at another point in the interview 
they might describe what was going on in their lives that motivated them to sign 
up for the program, and we coded this information "contextual factors." We then 
read and coded all the interview transcripts for that group, revising the coding 
categories until we had accounted for all the information presented by this group. 
This process was repeated for all the groups of participants-students, tutorsAin- 
structors, program directors, and partners. At the end of this stage we had approx- 
imately 35 coding categories that were used across the entire data set. 

The next stage of the analysis involved the use of a computer program, Eth- 
nograph, that functions as a data management system. All of the interview tran- 
scripts were on file in this program, and the coding of all the information in each 
interview was entered. Ethnograph then sorted these data according to our direc- 
tions, most commonly by specific codes. For example, we asked Ethnograph to 
find all the suggestions that anyone made for changes in the program, and it 
searched the entire data set for any information with the code "changes" and 
primed those out. It also enabled us to search for related codes at one time, or to 
search for a code only within a particular group, such as students. The computer 
program thus enabled us to access similar data across all the interviews. 

The final stage of analysis involved examining the sorted data and determin- 
ing what common themes were present. This is very much an inductive process 
but the data usually provide very clear and unambiguous findings at this stage. 
For example, when we analyzed the coding category "partner interaction," ten 
themes emerged that we saw as characteristics of successfiil partnerships from 
the perspective of those involved. These in turn became an essential part of the 
framework for our model of effective programs. The emergent themes from the 
data, then, contribute directly to the fiiKlings of the stiidy. 

It is important to understand that this study, like all qualitative studies, de- 
scribes reality from the perspective of the participants in liiat reality. It is an in- 
terpretation, not a representation, of that reality. This stuc?y tells you how these 
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people experience and inierpret these partnership programs. Our assessment of 
effective functioning of these programs, then» is based on these perceptions of all 
the people involved in the programs, rather than on specified outcome criteria. 

With that in mind, the report of findings follows. The findings are presented 
in two broad groups. The programs are first discussed in macroscopic terms- 
how the programs were implemented, how the partnerships ftmction, and how the 
program delivery systems work. The findings then present the internal view-the 
perspectives of the people directly involved in the provision of literacy services. 
The findings allow us to understand the partnership programs from a systems 
model. The macro-program view shows us the programs in relation to their ex- 
ternal environmcni, and the micro-program view shows us the programs' impact 
on people. 



Partnering for Literacy 



Findings 

PROGRAM ORGANIZATION 

Program History 

In analyzing program organization and partnerships, a study of the first steps 
in a program is often illuminating. In this case, program history identified cata- 
lysts for the programs-need and initiators. 

Two needs addressed by this grant had already been identified in communi- 
ties. Private Industry Councils (PICs) and literacy providers had both seen a 
need to offer literacy services as a step towards employment for the economically 
disadvantaged but were limited in providing such services under previous JTPA 
programs. Also, in communities with established literacy councils, the need for 
cooperative public and nonprofit efforts in providing literacy services across a 
The idea of partner- community had already been seen. Thus, when the Request for Proposal (RFP) 
ship programs was a from the Texas Literacy Council arrived in Service Delivery Areas (SDAs) 

good fit to meet across the state, the idea of partnership programs was a good fit to meet existing 

existing needs. 
needs. 

Although the initiators of the grant applications varied, action typically came 
from the PIC or from a nonprofit literacy council. Getting the announcement 
onto the desk of the initiator is vital. For programs in larger communities, a staff 
person at the PIC or literacy council who reviews RFPs is a successful channel. 
For programs in smaller communities, luck sometimes appeared to play a part in 
whether an initiator heard about the RFP and decided to assemble the parmership 
team necessary to complete the grant application. 

Enhancement of program start-up occurred two ways. Literacy programs that 
were already in existence drew from their experiences to design grant programs 
that acknowledged problems and planned solutions, proposing increased effec- 
tiveness of the program. And the fact that some or all of the partners had worked 
together on other projects prior to this program facilitated cooperation and exert- 
ed a positive influence on the program as a whole. 

The major problem identified in applying for and initiating a program is time. 
Regardless of the initiator's experience in preparing grant applications or the 
partnership members' experience in working together, the process of choosing 
appropriate partners, developing an agreement on the project goals and design, 
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and preparing the grant application is time-consuming, as are most decision-mak- 
ing and planning processes. 

Once the application is submitted, the acceptance and funding process also 
takes substantial time. Because of changes in submissions and available funds, 
programs we visited had start-up dates ranging from October 1991 to February 
1992, all with a completion date of June 1992. This disparity in program length 
was one determinant for the use of a qualitative research method, since programs 
were not alike and could not be compared quantitatively. 



The major problem 
identified in applying 
for and initiating a 
program is time. 



Enabling Factors 



There are certain factors, discussed below, which help a program to achieve 
an effective start, smoothing the way towards providing the literacy services 
needed by the students. These three factors occur in the data in descriptions of 
both successful and unsuccessful programs. The presence of any one of these 
factors is a plus. The presence of all three factors contributes to the rapid success 
of a program. 

The first factor is that the program has dovetailed into existing literacy ser- 
vices. It is planned as an extension of literacy services already offered in the 
community, filling a need that the current literacy programs have been unable to 
meet. Or, it is a pilot program to meet a new need or a hidden target population, 
complementing programs already in place. 

The second factor is that the program has drawn on auxiliary resources out- 
side the partnership for help and support. In the Dallas program, development of 
a site-specific curriculum for the deaf was aided by voluntary assistance from 
nearby educational experts, and the program director drew in resources from as 
far away as Pennsylvania for ideas. 

The third factor is that the program has goal-directed people involved in the 
program partnership. Because they are competent to provide educational servic- 
es, to administer the program, and to work in a partnership format, they concen- 
trate on providing a quality program. 

What is particularly noticeable here is the synergistic effect of the factors 
working together. The first two cleariy place the literacy program in relation to 
existing literacy services within and beyond the community. The program devel- 
ops a central goal which can then be supported by the goal-directed people de- 
scribed as the third factor. The focus provided by these enabling factors builds 



The synergistic effect of 
the factors working 
together is particularly 
noticeable. 



ERLC 



24 



3u 



Partnering for Literacy 



an effective delivery system for literacy services. 
Funding 

Of the fifteen programs, ten share the grant money among the partners; five 
do not. Most of the programs made a group decision on division of the money 
prior to submitting the grant application. This funding distribution can change 
over time as a program receives additional years of funding, and as the partner- 
ship undergoes some revision to become more woikable. 

In El Paso, the on-going program exhibited strong partnership agreement on 
all issues, including funding. One partner interviewed stated that when she first 
became part of the process, she expected the attitude "What's in it for me?" She 
discovered that the existing partnership attitude is "What can I contribute?" In 
this SDA, the PIC is seen as fair-handed, allocating funds as needed. 

However, funds allocation can be an area of dissension among the partners. 

Partners in some programs would like to receive information on funds distribu- 

Funds allocation can . . t_ . i_ • ui r • ^ u ^ u i ^ 

tion, perceiving their share in the program as possibly unfair. Others felt exclud- 

be an area of dissen- 

ed from the decision-making process rather than from fair allocation of funds. 

sion among the 

partners TTiese attitudes support the necessity for development of a fully communicating 

partnership which can change as partner needs change. 

The PIC is usually the grant administrator, but in at least one case-in Belton/ 
Temple/Killeen-the administrative agent is the literacy provider. Where the PIC 
serves merely as a channel for the funds, partner disagreement over the grant can 
occur. In one program, a partner was allocated the entire grant which upset other 
partners who felt they were excluded from the program. As a result, the remain- 
ing partners were reluctant to get involved in the partnership process, waiting to 
be asked to participate rather than volunteering. 

An unusual approach was taken in the Waco program. The PIC sought bids 
from literacy providers in their SDA, subcontracting with two for delivery of lit- 
eracy services. While the practice of bidding is usual for the provision of prod- 
ucts to public agencies, it is not often used for the provision of services. In this 
SDA, problems were encountered with the bidding process. Only one suitable 
subcontractor, who could serve only a portion of the SDA, responded the first 
time bids were requested, requiring a second bidding process. The second sub- 
contractor found is located at a distance from the participants. Bus service to one 
subcontractor's delivery site was arranged by deobligating a portion of the funds 
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from the other subcontractor. 

Program partners realize the external needs for child care and transportation 
assistance to support the ability of participants to attend literacy classes. While 
some programs do not attempt to meet these needs, others include their costs in 
the grant funds or as a supplement to program func's provided by partners or aux- 
iliary sources. 

While determination of actual cost-per-student for each program was a goal 
of this project^ that goal could not be met Forms requesting direct, indirect, and 
in-kind costs were distributed to program administrators for completion by each 
partner. However^ the information provided varied widely. Some partners com- 
pleted the form for actual costs to date (date of the interviewer's visit), others 
completed the form for the grant year» predicting costs to June 30, 1992. Some 
partners included every possible item of in-kind contributions, while others gen- 
eralized to larger contributions. These responses, plus on-site observations of do- 
nated furniture and equipment ranging from recently purchased discount file cab- 
inets to antique oak bookcases to computers of all ages, require future detailed 
analysis for true cost assessment. 

The most serious problem related to money is the funding cycle. Some pro- 
grams' funding started in October^ while others started as late as February, all 
with a June 30 ending date. One program staff stated that they had received noti- 
fication of the grant award in October, but in March they were still awaiting a 
signed contract. Programs are expected to show substantial faith and to develop 
temporary funding sources in order to provide services during the interim. How- 
ever, the programs are still held to their original objectives, regardless of the re- 
duction in time available to reach those objectives. 

In addition to the slow receipt of funds at the beginning of a program, the 
ending dale also produces a funding problem. If a program applies for a grant 
the following year, the wait between the end of one program year and notification 
of an award for the following year can be three months. This means programs 
are actually providing services for nine months instead of twelve. The gap in 
funding is most critical for small programs which must stop providing any servic- 
c when the program year ends on June 30. The small program is likely to lose 
participants (who do not understand why the three-monlh-delay occurs) and to 
lose volunteer staff to other pursuits. 



The most serious 
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Business Linkages 



Business-and-industry 
linkage in the partner- 
ship is crucial 



According lo the RFP, "the purpose of this grant program is to create or en- 
hance local partnerships between Private Industry Councils, local nonprofit liter- 
acy councils and one or more of the following: public libraries, adult ba^ic edu- 
cation providers, commuruty based organizations, community colleges, technical 
institutes and universities." It is clear from our interviews that the programs are 
structured to include these partnership entities. 

The connection between the literacy program and the PIC is not always 
strong, though. If the PIC is the grant administrator, then this relationship is 
forged through on-going contact. PIC staff often visit the program site and com- 
municate with the program director, collecting "success stories" to share with 
PIC members. The Education Subcommittee at one PIC is very interested in the 
outcome of the program. In another SDA, one partner described the PIC as being 
"right-handed, and they have their right hand in this program," which is evidence 
of definite partnership in the program. 

However, in other SDAs the literacy partnership program is left to survive on 
its own because of the perception that these funds are a very small grant for the 
effort required. When the PIC serves only as a pass-through agent, receiving the 
funds and directing the money on to the literacy council or another entity for dis- 
semination and administration, the connection between the program and the PIC 
is weak. If the PIC's involvement is slight, the partnership may suffer, or may 
even dissolve. 

Because JTPA monies are intended to support ventures into public-private 
partnerships to more effectively match employer and social service/training 
needs, business-and-industry linkage in the partnership is crucial. As evidenced 
by the Wichita Falls program, which successfully went to the business communi- 
ty asking for advice and input into the development of a curriculum which could 
teach literacy and math skills with a job focus, business and industry leaders want 
to support programs which allow them to remain in a community, employing a 
local workforce- Since approximately 50% of the programs offer job skills train- 
ing-a category including interviewing, resume or portfolio preparation, and 
learning to worV. in groups-a strong partnership with businesses would allow pro- 
grams to refine their curriculum to more closely match employer needs and par- 
ticipant desires. As discussed elsewhere in this report, the most often expressed 
goal for students is to find a job. 
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Ties to business and industry in each local area can be strengthened. Where 
some business input is now provided by PIC staff or by spouses of program staff 
who are influential in the business community, it appears that programs could 
benefit from the marketing, fund-raising, and management skills of the business 
community. In return, programs could provide students with skills which are 
transferable to a woA environment as well as being personally rewarding. One 
partner in Corpus Christi expressed the business community*s attitude towards 
the program, saying, "Just the atmosphere of the town is something the business 
community needs. It's not for things for all of us to make mcHiey off of" 



PARTNERSHIP BEHAVIORS 



Types of Structures 



In the grant proposal, the services each partner will contribute are delineated 
as a means of describing the program organization. What we found in the field 
was two differing patterns for organizational structure based on the actual inter- 
action between the partners. These patterns are (1) a top-down hierarchical struc- 
ture, and (2) a network. 

The hierarchical structure is typical of very small programs composed of the 
PIC. the nonprofit literacy council, and another social service agency or commu- 
nity-based organization. In several cases, the PIC is located in a community at a 
distance from the program. In this structure, responsibilities of each partner have 
clearly observed boundaries. The grant administration and management is com- 
pletely handled by the PIC at the top of the hierarchy. The literacy council pro- 
vides the literacy services and the remaining parmer(s) provides referral, program 
site, or other support services. Meetings among the partners are rare, with most 
of the problem-solving and networking responsibilities left to the literacy coun- 
cil, which may or may not have the staff to support such efforts. 

The network is found in more complex partnerships involving educational 
partners and social service agencies as well as the nonprofit literacy coimcil and 
the PIC. In this structure, the boundaries of responsibility are more flexible. 
The PIC provides grant administration, participates actively in meetings, and pro- 
motes partnership interaction. Partners may switch or revise responsibilities in 
adapting the program to meet their objectives during the program year. For ex- 
ample, when partners in one program determined that the intake and assessment 
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comes the link which 
maintains the partner- 
ship between agencies. 



processes were clumsy when performed by different partners at separate sites, 
they agreed that one partner would perform those functions, traveling to all sites. 

Although partners are strongly committed to the program, the schedule of in- 
volvement by some partners varies. In one partnership, representatives of all 
partners meet on a regular basis. However, a partner with responsibility for refer- 
ral may hold several neighborhood meetings to recruit participants at the pro- 
gram's inception, then become less active in the partnership until again needed. 
Communication becomes the link which maintains the partnership between agen- 
cies, and this linkage is only effective if it is accepted as important by the group. 



Partner Responsibilities 



Typical activities of the partners involved in this program are referral of par- 
ticipants, active recruitment of participants and tutors, public relations/communi- 
ty awareness education, program intake, JTPA eligibility certification, curricu- 
lum development/revision, literacy services, counseling, grant administration, 
functional decision-making, child care, transportation, tutor training and over- 
sight, extension into other training programs (such as family literacy or pre- 
GED), and outreach to nonpartners. While even small partnerships see the need 
for the variety of services and responsibilities required to provide literacy educa- 
tion, programs with larger partnerships are more likely to be able to meet those 
needs in a cost-effective manner. 

For example, a small program with few partners may need to provide child 
care and transportation in the budget. A larger partnership may be able to pro- 
vide alternative solutions for child care and transportation because of a larger re- 
source network. In the Corpus Christi program, the local bus company provides 
tickets which are distributed to students who have transportation needs, even 
though the bus company is not an official partner. 

Administration and grant management are usually the responsibilities of the 
PIC, or its designee such as a Council of Governments (COG). While some pro- 
grams include the literacy council and other partners in the funds management 
system, some do not. This is usually a partnership decision and is tied to subcon- 
tractor agreements in the SDA. While one program chooses to focus strictly on 
delivery of literacy services, another program's partners would like to know ex- 
actly how the funds are disuibuted. 
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Partner Contributions 



The organizational strength of the program is dependent on the partner-to- 
partner relationship. The strongest program develops when the PIC, the iwnprofit 
literacy council, at least one formal educational partner and at least one social 
service agency partner actively v^ork together. The weakest programs occur 
where the PIC is located at a distance from the program, where the literacy coun- 
cil has no experienced educational supports and where referral is the only respon- 
sibility of the other partners. 

Organizational strength in a partnership is important to insure that partici- 
pants arc identified and referred, that the social service needs of the participants 
are addressed, that social service funding dollars meet allocation schedules with- 
out overlapping, and that the program's activities support its objectives. The part- 
nership is improved when many partners contribute actively to the program. The 
ability to solve problems and meet the various needs of the participants is en- 
hanced v^'hcn a group of partners with many capabilities are working together to 
develop solutions. 



The partnership is 
improved when many 
partners contribute 
actively to the program. 



Exemplary Partnership 



As intcmcw data were analyzed, a description of what would make the part- 
nership work more successfully was developed. The elements of this description 
include Overall responsibilities for different types of parmers in the programs. 

The PIC should be actively administering the grant by regular and impromp- 
tu communication with other partners and by streamlining the JTPA paperworic 
process. Partners recognize and accept the need for a record-keeping process, but 
most have commented about unrealistic administrative expectations. The paper- 
work is often described as a nightmare, especially in requirements for informa- 
tion often not available from the group of participants for whom these programs 
are targeted. 

In programs where the PIC is located at a distance from the literacy council, 
PIC staff involvement is crucial to help the program build partner networks and 
find resources. Where social service agencies provide referral and eligibility 
documentation for participants, their support for the program is vital. The PIC 
can encourage a regular meeting process for problem identification and solution, 
plus serving as a catalyst for bringing additional resources and partners into the 
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Literacy councils are in 
a special position in 
these partnerships. 



process. 

Education agency partners should contribute information about current trends 
and new ideas in adult education. Using program curricula which are adapted to 
the participants being served, an increase in completion rates and an increase in 
staff and participant satisfaction with the program can be expected. While pro- 
grams provide the best literacy services they can, program staff are aware of 
changes which can increase participant retention rates and accelerate adult learn- 
ing. Educational partners can provide a needed information resource in this area. 

Social service agencies which see these same clients should develop a "safety 
net" to insure that eligible participants arc referred to the program. In addition, 
they can devise innovative solutions to the pervasive problem of losing clients in 
the shuffle from one agency office to another. In Wichita Falls, partners tele- 
phone each other when potential participants have been referred so that the par- 
ticipant can be warmly greeted at the next office. In Qebume, the JTPA office 
sends a representative to agency offices on a regular basis to complete intakes, 
thereby simplifying the application process for participants. 

When partners know the social services offered by each other, they can 
match survival needs of potential participants-child care, transportation, vision 
testing, food, clothing, shelter, and counseling-wilh existing services. This helps 
participants become ready for literacy education and promotes the primary func- 
tions of each agency. In addition, a working partnership can help all partners to 
understand the differing focus and viewpoint of the many public agencies, non- 
profit groups and private businesses who care about literacy needs. 

Literacy councils should concentrate on their mission to educate participants, 
to Inform the public about literacy, and to connect literacy providers across a 
community. Literacy councils are in a special position in this partnership. As 
nonprofit agencies, they can function as the facilitators of problem -solving. They 
can unite social service agencies which are part of the public bureaucracy com- 
peting for limited funding dollars. They can also bring the business sector into 
the partnership through volunteers, donations, and in-kind services. The ability 
of the nonprofit organization to unite community support in solving problems 
which cannot be solved by public funding alone should not be underestimated. 



Successful Partnership Behaviors 



The partnership arrangement which occurs in these programs differs from 



ERIC 



Partnering for Literacy 



site to site. This is partially a function of the existing literacy and social service 
agency network and partially determined by the time available to reply to the 
RFP and apply for the grant. The number of partners in a program ranges from 
three to fifteen, and some programs have added partners partway through the 
grant year as community support for the program increases. 

Our interviews elicited descriptions of behaviors which characterize suc- 
cessful partnerships. In fact, the people we interviewed provided a substantial 
amount of data regarding good, and not-so-good partnership behaviors, enabling 
the development of ten "successful partnership** characteristics. Most programs 
exhibit many of these characteristics of successful partnership, with some charac- 
teristics stronger than others. 

However, not all programs are successful at partnership interaction. The pro- 
grams where the partnership is weak or nonfunctional also have poor quality lit- 
eracy services. They have problems coordinating child care and transportation, 
they have problems getting participants into the program, they lose many partici- 
pants in the eligibility process, the curriculum does not meet participants' needs, 
and the program staff shoulder a tremendous amount of responsibility for pro- 
gram function. The comments made by interviewees from these programs were 
an important pan of shaping the limits for characteristics of success. 

Descriptions of the interaction between the partners were rich and detailed. 
It was in this category that we acquired the most similes and metaphors during 
our conversations with the interviewees. The metaphors which are included in 
the characteristics below are quoted from the interview data. 

1. Successful partners have FACE-TO-FACE CONTACT. They meet to- 
gether on a regular basis to discuss the program. Monthly meetings are consid- 
ered most profitable. The meeting schedule for on-going programs, e.g., third 
year grants, may be more irregular, depending on the partners. Smaller meetings 
interspersed with meetings of the full partnership are seen as effective time man- 
agement. In Corpus Christi, the program holds staff meetings to resolve delivery 
problems on an alternating basis with partner meetings. This face-to-face conuct 
allows for both conflict resolution and establishment of personal, human connec- 
tions vital to all communication. 

2, Successful partners LEARN how to function together. In Qebume, the 
partners started by meeting every two months. They soon realized that was not 
often enough to be effective, so a monthly meeting schedule was established in- 
stead. At another program, one partner said they may have disagreements at the 



Descriptions of the 
interaction between the 
partners were rich and 
detailed. 



32 



Partnering for Literacy 



Strong partnerships 
view all of the 
partners as valuable 
contributors. 



They see '^many roads 
to Rome,** 



meetings, but the partners need to hear each other's point of view. Partners 
"view meetings as important enough to send a representative if they can't make 
it," reports one interviewee. They are willing to try to work together even if they 
have not done so before. 

3. Successful partners COMMUNICATE. They not only have meetings, 
but they talk with each other on the phone regularly. They work to insure that all 
partners receive copies of minutes from missed meetings and agendas for future 
meetings. They network with each other at the "worker bee" level, "where the 
rubber hits the road," getting to know the contributions and limitations of each 
other as agency representatives and as human beings. It is the continued commu- 
nication between partners, even when a partner is less active, that makes the part- 
nership successful and ongoing. Strong partnerships view all of the partners as 
valuable contributors on the basis of timely services rather than measuring equal 
contributions. 

4. Successful partners BUILD BRIDGES. They are willing to go out of 
their way to help each other, to make the partnership work. "We're like a fami- 
ly." They see lack of political jousting and the absence of turfism as important 
for partnership functioning. They establish close relationships with any agency 
thai serves the same clients. They don't wait for someone else to make the first 
contact. One partner detailed a personal persuasion process by which he talked 
the local college into not just passively supporting but actively advocating the 
program. 

5. Successful partners have REASONABLE EXPECTATIONS for the 
partnership. They understand that social service agencies have different goals, 
priorities, and funding limitations than nonprofit literacy councils or private sec- 
tor contributors. They don't expect everyone to be perfect all the time. "You're 
always going to have growing pains." says one partner. 

6. Successful partners are FLEXIBLE. They allow for differences in philos- 
ophy towards students^ in management style, and in ability to contribute to the 
program. They see "many roads to Rome" and look for ways to help each other 
feel needed in the program partnership. The partners adapt as the program 
changes over time; they see ways to revise and improve the program to make it 
more successful. 

7. Successful partners SOLVE PROBLEMS. Rather than be stopped by a 
problem, they look for solutions and alternatives. They ask for change from one 
another, they ask for change in the bureaucratic system. The Qebume program, 
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which was not meeting its target for students, saw potential participants slipping 
away in the Adult Probation program. Working as a partnership, the literacy 
council and probation officers developed a solution which was willingly adopted 
by the district judges. 

8. Successful partners are MAGNETS. Because they work well together, 
other people want to belong and be successful, too. The partners pull in addition- 
al partners, gaining community support. In El Paso, one interviewee said they 
started with thirteen partners this program year and continue to add partners as 
the year progresses. 

9. Successful partners have a COMMON GOAL. They never lose sight of 
the reason they are working-the students. No matter how successfully a partner- 
ship interacts, if the students are not enrolled or the students don't stay, the pro- 
gram is not a success. The partners work hard at the partnership because they 
care about the students. One partner described the interaction among the partners 
as the need to "gee and haw," or pull in harness together. 

10. Successful partners have at least one STRONG LEAD PARTNER to 
keep the interaction going. According to one partner, it's the leader^s responsibil- 
ity to "water all these little flowerbeds all over town." For example, the program 
director in Cleburne takes responsibility for communicating with the other part- 
ners» for calling meetings and organizing locations, and for keeping the partners 
motivated with the program. The lead partner typically keeps an "eagle's eye 
view" on the partnership process to encourage its continuance. But other partners 
are willing to assist and support the lead partner. 

These ten characteristics of successful partnership are the behaviors which 
allow the program to function well on a daily basis. These characteristics define 
the partnership as a process of cooperation and connection, building a flexible 
structure which is anchored among the partners and which supports the literacy 
services. 
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Partners in the program evidenced broad understanding of the day-to-day 
problems which must be solved in order to provide literacy programs-transporta- 
tion, child care, appropriate locations and hours of service, counseling and es- 
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diamonds in the 
rough,** a great re- 
source for the nation. 



teem-building. They also expressed a deeper understanding of their purpose. 
Partners described a philosophy of adult education which sees students along a 
continuum. On one end, the goal of adult education is "remediation" in which 
the student is a passive receiver of services, whose needs are determined by the 
provider. They view students as relatively helpless and imable to "get on with 
their lives" without assistance. 

On the other end, the goal is more than teaching basic skills in preparation 
for jobs. These partners want to help students view education as fun, as a means 
of building self-esteem, and as an opportunity for improved quality of life. They 
focus, as in the Levelland program, on meeting their students on an adult level. 
They see students as partners in the program, too, partners in the learning pro- 
cess. One partner say. that students are "diamonds in the rough," that they are a 
great resource for the nation that can be tapped through education. Another part- 
ner uses group discussions to allow the rich variety of life and woric experiences 
of students to be shared among their peers, helping everyone. 

The philosophy towards adult education which espouses the view that adults 
contribute to the educational process, even low-level literate adults, is more com- 
monly found among partners who are trained in professional education. These 
panners see the students as more than bodies to be channeled into programs and 
counted as successes or failures at the end of the program. They see the students 
as having needs which are not directly expressed, but which are needs to be met 
by the program all the same. These are human needs for connection, for recogni- 
tion, and for dignity. 



Curriculum 

Programs think of themselves as student-centered in curriculum and flexible 
in schedule. Over and over again, partners stated that the programs like to focus 
on the individual, to give specialized design through one-on-one tutoring and 
monitoring of the computer programs to insure than the participants are success- 
ful at learning and to help participants avoid learning situations in which the they 
were not successful in the past. This one-on-one approach is emotionally re- 
warding for the teacher or tutor. 

In practice, standardized curricula such as Laubach or LVA may be using a 
far less individualized approach for meeting the real learning needs of partici- 
pants. While it is important to keep the participants on track, teachers should be 
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aware of the participants as adults who want to be there. Some teachers have de- 
veloped a range of additional methods and materials to make a standardized cur- 
riculum more relevant to the needs of the participants. Other tutors with good in- 
tentions but little educational experience receive little direction and may be im- 
provising with a curriculum based on their own perception of what is appropriate. 

Motivation is likely to stay strong longer if students see a direct connection 
between their goals, such as obtaining a job, and what they are learning. To that 
end, some programs have begun reviewing and revising their curriculum offer- 
ings to reflect their participants' perceived needs. 

Several programs took on development of a site-specific curriculum to meet 
the needs of their potential participants as part of this grant program. While these 
programs have been successful at developing a curriculum, the time involved in 
such development has had a negative impact on the time available to deliver liter- 
acy services and to allow participants to meet targeted goals for literacy improve- 
ment. The usual curriculum development process, which includes a pilot pro- 
gram and revision of the curriculum, is planned in each instance. However, com- 
pletion of the curriculum will not occur under the partnership grant program un- 
less the program site is refunded in the next grant year. 



Several programs took 
on development of a 
site-specific curriculum 
to meet the needs of 
their potential 
participants. 



Delivery 



Programs are structured on three variations-one-on-one tutoring, group class- 
es, or a combination of the two with one-on-one tutoring for beginning partici- 
pants and classroom groups for reading levels above fourth grade level. A pro- 
gram which offers only one-on-one tutoring is likely to be small, yet is probably 
the most flexible for the participants, offering schedule and location options that 
meet the needs of the participant and the tutor. 

Programs witli structured classes have fonnal schedules in specific locations. 
While this may be less flexible for student schedules and cause transportation to 
become an issue, the formal classes serve several purposes: First, participants ex- 
perience a different learning environment from previous classrooms; second, 
peer support is available; and third, the program director can verify student 
achievements and provide tutor support as needed. In addition, a committed lo- 
cation for classes is often a location which provides computer labs as well. Sev- 
eral programs are open during nonclass hours for student study or practice on the 
computers. A number of programs provide both one-on-one instruction, espe- 
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only a portion of what is offered during the day, not the full complement of 
courses. One program offers family literacy as a night class, making it possible 



cially for lower-level readers, and classroom instruction. 

Classroom programs are also flexibly scheduled, with programs offering both 
■ day and evening classes where possible, and in different locations which are ac- 

In one program, the cessible by parucipanis. In one program, the local has seivice stops at 5:00 p.m., 
local bus service stops evening classes have been arranged at a school within walking distance of 

at 5:00 p.m., so evening neighborhoods of potential participants. Typically, the evening program offers 
classes have been 
arranged at a school 
within walking 

distance. parents to participate. 

One common problem for scheduling is the grant ftmding cycle. With a small 

program which is planned to start in October and finish at the end of June each 
year, participants who are enthused and motivated to continue must wait three 
months-July, August, and September-for a new funding cycle to begin before 
they can resume the program. This means that programs must maintain contact 
with participants during that time who often have no telephones in order to help 
them stay in the program. The commitment of volunteer tutors and other staff 
must be maintained as well. For programs that are only a portion of a larger liter- 
acy effort, the participants can be continued if other funding is found during that 
three-month period. 

Later in this report we explore more fully some participant perceptions of 
scheduling. Not all programs offer schedules which fuUy meet the needs of their 
participants, although partners typically expressed an awareness of those needs. 
Some programs offer unscheduled times for students to come in and study on 
their own or work with the computers. Many programs report that participants 
have asked for more classroom time and more free time, especially for work with 
the computers. 

Technology use is supported by the programs. Approximately two-thirds of 
the fifteen programs use computers and have labs available for students to prac- 
tice on the computers. One fomier participant stated he liked the computers be- 
cause this was something new, something that his friends and neighbors did not 
know how to do; computers are perceived as special, not remedial work. Most 
programs report that participants are highly motivated to work with the comput- 
ers and plan to provide more when funds and useful software make it possible. 

All of the programs evidenced understanding of the social problems which 
limit a participant's ability to come to class. Two big limitations for the potential 
participants in this program are child care and transportation. These two lirnita- 
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lions prevent the participants from obtaining other social services such as food 
and shelter assistance as well as literacy services, and are problems which social 
service parmers have been working to resolve. Literacy providers often find that 
the partnership allows the program to offer child care and transportation services 
contributed by other partners. 

Literacy programs are offered in a variety of locations, depending on avail- 
able resources and the transportation needs of their participants. The most typi- 
cal locations are libraries (for one-on-one tutoring), independent literacy centers, 
literacy centers adjunct to other social service providers such as a job training of- 
fice or a jail, and educational institutions. One program. Corpus Christi, found 
participants accepted a college location with enthusiasm, since approval is given 
to participants by their peers for "going to college." Another program, Browns- 
ville, determined that part of their success is their location right in the housing 
complex where their participants live. The program has become an accepted part 
of the community. 

While the partnerships make the program happen at the macro level, the actu- 
al contact between a person with needs and a person who can assist occurs on the 
micro level. People connecting with people offer a perspective on the program 
which is just as important as the external perspective. In the next section we be- 
gin presentation of the findings which are detailed, people-specific perspectives 
from the program staff 



Technology use is 
supported by the pro- 
grams. 



COORDINATING EFFECTIVE PROGRAMS 



Effective functioning of the partnerships at the program level involves a vari- 
ety of processes. First, program directors must hire competent staff members to 
assist in the operation of the programs. Some of the program staff members are 
paid, but a large percentage are volunteers. Some are hired after JTPA funding is 
awarded, while others have been involved in literacy programs that are continu- 
ing and expanding due to the additional funds received. Whether the program is 
in its infancy or has been operating for many years, each program director want- 
ed to attract staff members with specific qualities that would enable the program 
to operate most effectively. 
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Staff Recruitment 

The qualities sought in staff members are divided into two major categories- 
education/training and background/experience. Applicants with the highest qual- 
ifications are most desired. Most of the literacy programs prefer to hire staff 
members who possess a bachelors degree in education. A teaching certificate is 
another preferred credential. The most important quality the applicant can pos- 
sess is prior experience with the target population. Often, a program director will 
opt to hire an applicant without a degree if that applicant has a high school diplo- 
ma and documented experience in human services. One director had this to say 
about recruitment efforts: "I'm not interested in looks. I'm not interested in cre- 
dentials as much as I am in experience." 

Similarly, there is a growing interest across the state to hire specialists with 
backgrounds in curriculum development, reading, learning disabilities and En- 
glish-as-a-second-language (ESL). Additionally, applicants who speak Spanish 
are preferred since a large percentage of those enrolled in the literacy programs 
are Hispanic. 

— In addition to the educational and experiential qualities just mentioned, per- 

The most important sonal qualities are also an important hiring consideration. Program directors 

quality an applicant for commented that their staff needed to be "good with people," sensitive, patient, 

a staff position can empathetic. One director said their staff members needed to be "one-half 

possess is prior 



experience with the 
target population. 



missionary. 

The evaluation team was interested in determining how the staff is recruited 
since most programs must work within a limited time frame and since obtaining 
qualified staff is crucial to the success of the program. The most effective form 
of staff recruitment and advertising reported was by "word of mouth." However, 
other sources of advertising for staff positions are also utilized. The most cre- 
ative source was related by the literacy council in Texarkana which has a speak- 
ers bureau in place. Speakers representing the literacy councU address civic and 
religious organizations to gain community interest and support in literacy en- 
deavors. In addition to these two methods, other traditional methods of advertis- 
ing include the use of newspapers, radio, and the Texas Employment Commis- 
sion. Finally, other partners were sometimes mentioned as good sources of ad- 
vertisement and recruitment. 



ERLC 



Partnering for Literacy 



Staff Description 



We found that those people who are eventually recruited, whether paid or 
volunteer, bring a high degree of education and experience to the program. Most 
of the staff members do have the desired background in education or a related hu- 
man service field. Aside from education and experience, the commitment and 
caring exhibited by the staff is surely the "life blood" that keeps the programs go- 
ing. It was reported that some paid staff members come in on weekends on their 
own time to make the facility available to participants who are hungry for knowl- 
edge because as one person put it, "you just have to be there when they can be 
there." 

Other signs of staff concern are exemplified by those who go the extra mile 
to see that applicants in need of literacy services receive help in collecting the ap- 
propriate paperwork to document JTPA eligibility. Some staff have gone into 
homes to help participants find the correct paperworic (a difficult task for a per- 
son who cannot read). We found that empathetic staff members often go to great 
lengths to accommodate the needs of potential participants. One director com- 
mented that, "the minute they walk through that door or make that phone call, 
then we want to make it easy from that point on." 

And the caring goes beyond the learning environment as well. Some staff 
members take participants with health problems to a doctor for medical treat- 
ment. They call participants while they are in the hospital to let them know that 
they arc cared about as individuals. The staff do what they can to reduce as 
many obstacles as possible that stand in the way of successful outcomes for stu- 
dents who are trying to better themselves. 

In addition, staff members get excited about student successes. They enjoy 
sharing in the accomplishment of the students, as is evidenced by the following 
remaric from one staff member: "We had a party for a woman who used to be in 
our program and got her GED recently. And we bought her a gift by pooling our 
money together. We were so excited for her because she had some problems and 
perhaps those problems were barriers to her getting the GED, We think she is re- 
ally a success." 

Though the staff bring a wealth of compassion, experience and knowledge, 
we discovered that tenure in the program for most staff members is unusually 
brief. This phenomenon is probably due to the lack of continuity of funding, 
since the smaller programs depend on JTPA funds for their existence. Without 
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year-round funds, the smaller program activities are halted or reduced and often 
the staff members move on to other endeavors. Additionally, those programs that 
begin after the public schools are in session lose the opportunity to hire potential 
instructors. 

While many of the staff members stated that this was their first year in the 
program, there are a few who have been involved in literacy for several years. 
This was not the norm, however. One program, for example, has been funded for 
three years and has had a new program director each year. The process of stop- 
ping and starting each year, whether it is caused by interrupted funding cycles or 
a turnover in personnel, negatively affects the quantity and quality of services 
that can be provided. Strategies to reduce these inconsistencies should be identi- 
fied. 

Siaff Development 

The first training most instructors receive when they enter the program is a 
12-15 hour Laubach course. The training is transmitted through a variety of 
methods. Some of the new instructors are self-taught-they watch a video tape or 
review printed materials on their own. Others receive one-on-one instruction 
from peers, while some participate in group training. Some received no training 
at all. 

While many new instructorAutors say they are satisfied with the training they 
receive, others feel they could benefit from in-service training opportunities. 
They indicated that additional training sessions addressing availability of com- 
plementary resources, or development of individual teaching materials would 
strengthen iheir tutoring abilities. And, as one program director commented, 
" Wc want to get our volunteers and our paid staff into classes so that they are not 
just stuck on Laubach." 

Additionally, we found that while some staff members do attend state litera- 
cy conferences, there is little or no systematic training offered either locally or 
statewide. Consequently, the training of the instructional staff seems lacking. 

Without formal training, one program, Texarkana, started a tutor support 
group that meets regularly to allow tutors the opportunity to exchange experienc- 
es and ideas as well as share information and discuss similar concerns. These 
kinds of collaborative efforts benefit everyone involved in the programs. With 
little in the way of systematic staff development, the tutors still exhibited a sense 
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of tireless commitmeni and devotion to their students. We found that the enthusi- 
asm and appreciation expressed by the students and the words of encouragement 
offered by the paid staff went far in keeping the motivational levels of the tutors 
high. 



Participant Recruitment 

With a support staff in place, attention turns towards the recruitment of par- 
ticipants for the programs. Typically, the recruiting methods used for staff are 
also used for participants. Again, word of mouth was mentioned most often as a 
means for recruiting participants. Employers, friends, and family members 
served as excellent program promoters because these were people that the partici- 
pants trusted. In many cases their advice provided the incentive for initial enroll- 
ment by the participant. 



We found that while 
some staff members do 
attend state literacy 
conferences, there is 
little or no systematic 
training offered either 
locally or statewide. 



Participant Characteristics 



Before discussing participant involvement with the program, it is appropriate 
to describe the unique characteristics and experiences that define this target pop- 
ulation. This description is based on the perceptions of the staff members who 
deal with the participants daily. 

Staff members in the programs across the state have no problem in finding 
the disadvantaged and hard-to-serve people identified as the target population. 
What is difficult is to narrow down the list of those in need of literacy services 
and to obtain supporting paperwork. 

Many of these people are in the lower socio-economic levels. They have 
poor work histories sometimes caused by learning disabilities that have never 
been overcome. Many potential students lack social support at home as well as 
the self-esteem that is required to initiate involvement in a new educational en- 
deavor. Many of the clients also have health problems, for example, poor vision 
or malnutrition, that serve as major obstacles. 

The environments from which the potential students come are certainly barri- 
ers to their success. However, internal motivation drives many of these students 
to participate. Those who are parents are good parents, determined and tena- 
cious, who want to give their children opportunities they have never had. Often 
these participants were themselves "kids who slipped through the cracks in the 
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^'When they come to 
you, if you canU do 
something for them 
right then and let them 
know they are worth- 
while and that they can 
learn and thatyouWe 
going to help them, you 
wonH see them again.'* 



school system." Therefore, their pasts often haunt them. Many feel "beaten 
down" and have a tendency to become easily discouraged. They have failed so 
many times before in traditional educational settings that they arc uncertain and 
sometimes unwilling to risk another try. One staff member offered the following 
insight: "They are afraid and they are ashamed. When they come to you, if you 
can't do something for them right then and let them know they are worthwhile 
and that they can learn and that you*re going to help them, you won't see them 
again." Luckily* they do perceive education as the best means for improving 
their lives. One student had this to add: " Everywhere you go, they ask you for 
the GED. If you don't have it, you don't even get an application ... so it's hard 
for me to ask .... The one thing I am counting on is getting my GED." 

What these people needed most at the outset and continuing through the pro- 
cess was a friend, someone to "help them over the rough spots." There are al- 
ways rough spots and frustrations for students who feel they have so far to go. 
Luckily, the staff members, other Students, and family members provide strong 
support 



Participant Objectives 



Even when students do 
not have children or 
aspirations of attending 
college, they all want to 
find a job. 



One of the main reasons that students participate in the literacy programs is 
the desire to improve as parents. They are interested in helping their children ac- 
quire a better education than the one they had received and are additionally inter- 
ested in making improvements in their own basic educational skills so they can 
play a more active role in their children's eduration. 

Another common objective for students is the desire to obtain a GED certifi- 
cate. After being in the program for a while, students began to see that progress 
was possible. Some were even thinking beyond the GED and considered going 
on to college, particulariy a community college. 

Even when students do not have children or aspirations of attending college, 
they all want to find a job. Many need to first acquire basic skills, while others 
must participate in a literacy program to keep the job they have. 

The students interviewed had dreams of improving their working conditions. 
Some wanted less physically demanding work. Many students in this category 
were convalescencing from an injury and were using this time to increase their 
education, while others were simply interested in achieving greater autonomy or 
earning higher wages. Participants wanted the prerogative to choose employ- 
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mem rather than being obligated to settle for the lowest paying, least prestigious 
jobs. Some even expressed the desire to become self-employed. Many students 
were struggling to survive and were happy to have any job, but other students 
who had been in the program for a while began to express even greater career as- 
pirations. Mentioned most often were the helping professions, for example, nurs- 
ing and child care specialists. Additionally, the literacy students participating in 
computer-assisted instruction were also excited about increasing their computer- 
literacy skills and perhaps pursuing a computer-related profession. 

Other student objectives that didn't fall into the previous categories but were 
nonetheless important included the desire to reduce uncertainty about their future 
or the ability to function in an English-speaking society. Students participating 
in literacy programs with a concentrated ESL program expressed this final objec- 
tive as their primary concern. 

Participant Eligibility 
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Problems with the Process . Among the problems expressed by staff of the 
program sites, eligibility requirements for potential participants was most often 
indicated. Determining eligibility differs among the sites because at some sites 
the PIC staff assumes the major responsibility, whereas in other programs the lit- 
eracy council (partner) initiates the procedure, although the final decision re- 
mains with the PIC. Sometimes there appears to be some confusion in regard to 
the requirements themselves because the literacy council staff will determine the 
individual to be eligible, but the PIC staff does not agree. Therefore, the poten- 
tial participant becomes even more confused and hesitant about entering the liter- 
acy program. 

More specifically, problems associated with eligibility revolve around the 
following issues: 

There is confusion about some eligibility requirements. For example, staff 
always expressed frustration that "when the participant becomes employed, he or 
she must leave the program." Although this is a requirement, program staff per- 
ceive this as a penalty to those persons who are industrious and are seeking em- 
plo>Tnent while trying to improve their education. If a participant leaves the pro- 
gram because of employment and then loses that job, he or she must go through 
the lengthy eligibility certification process again before being allowed to resume 
the literacy program. That, in itself, discourages some from reentering the pro- 
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There is too much 
paperwork involved in 
the eligibility process. 



The potential partici- 
pant simply becomes 
discouraged by delays 
in the application 
process 
and goes elsewhere. 



gram. In addition, there is confusion about the criteria. Since sixth grade is the 
maximum level at which an individual can remain in the program, is that 6.0 (be- 
ginning of sixth grade), or 6.9 (end of sixth grade)? Does that mean sixth-grade 
level in all content areas, including math and writing, or only in reading? Or can 
the levels attained in each subject be averaged? Clarification for all program 
staff is needed. 

There is too much paperwork involved in the eligibility process. This was a 
common complaint by staff in all programs because of the myriad of paper re- 
quirements, i.e., social security card, driver's license, birth certificate (many 
older adults don't have them), rent and utility receipts, etc. 

In addition, many program staff indicated that the potential participants don't 
know what to look for because they cannot read what they have. Therefore, in 
some programs staff from the partner organization go to the home of the adults 
who want to enter the program and review their materials to help them meet the 
eligibility requirements, carefully going through a pile of papers which has often 
been poured from a box onto the kitchen table. As some indicated, "We're not 
sure it's worth the effort." That becomes a more critical issue when documenta- 
tion for every family member is required. 

There is too much delay between being initially certified and finally being al- 
lowed to begin classes. Once the partner or the PIC staff indicate to an individu- 
al, orally, that everything appears to be in order, there may be a two- or three- 
week delay before the official paperwork is processed through the JTPA office. 
Until that process is complete, an individual cannot officially be enrolled in the 
literacy program. Sometimes the potential participant simply becomes discour- 
aged and goes elsewhere, or in some cases, when the partner is trying to work 
within the criminal justice system, the individual is released from jail and cannot 
be easily located. If the individual has been transferred to a unit of the Texas De- 
partment of Corrections, there seems to be no way to receive information about 
whether the individual has been offered literacy classes. This was a concern to 
staff in some programs. 

There is often no coordination among the agencies involved in the certifica- 
tion process. Obtaining information from the Office of Human Services can be 
delayed, especially when the adult does not remember the name of his or her 
caseworker. Staff at one PIC will accept information from another agency in re- 
gard to eligibility certification through a telephone call or a FAX, whereas others 
will not do so. As indicated by some staff, "The more agencies involved in get- 
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ting information about eligibility, the longer the individual will wait before being 
certified." Unfortunately, paperwork is sometimes lost between agencies and the 
applicant must start all over again. Many will not do so. 



Problems with Referrals. Potential particip^.nts often do not keep appoint- 
ments. Regardless of who refers individuals to the programs, appointments may 
or may not be kept. This can be discouraging to the program staff, and some- 
times the staff members prefer recruiting their own participants instead of taking 
referrals from other agencies. 

Referrals are often reluctant to go to another site for the interview. When 
they must go to the JTPA office for assessment, particularly for the interview, 
some simply won't or can't go. Even when transportation is not a problem, po- 
tential participants do not wish to go to a site different from where they made 
first contact about the program, for example, the partner's office or the referral 
agcncy^s office. 

Some consider the paperwork too much of a hassle. Once the potential adult 
students learn how many records, receipts, etc., they must find, and how many 
forms they must sign, they are sometimes discouraged and simply don't return. 

Those with high school diplomas or GED certificates do not want to enroll in 
the program. They feel they have already proven themselves to be literate and al- 
though their assessment scores are low, they find the program enrollment recom- 
mendation/requirement too discouraging, so they don't return. 



They are sometimes 
discouraged by the 
paperwork and simply 
don't return. 



Problems with the Screening Process. When screened by both the partner 
and the PIC, the results are sometimes different and confusing to the potential 
participant. Sometimes one group tells the individual that she or he is eligible, 
but then the other does not approve the application. This in turn confuses and 
discourages the applicant. 

Those certified through a previous grant do not want to repeat the process. 
They feel they have already qualified the previous time Oast year), so why must 
they repeat the process? Their lives haven't changed, at least in their perception. 

The volume of paperwork itself becomes an obstacle for applicants. They are 
discouraged by what seems to be "piles" of forms to sign, and it is conceivable 
that less persistent adults drop out even before they start. 

There are virtually no instruments to adequately assess adults wiLh learning 
disabilities. For example, in Dallas, the Deaf Education Center provides the in- 
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take services because that is more efficient than training someone in the PIC to 
be able to do the intake. However, when such services are not available from an- 
other agency, the PIC must provide them and there is very little help available 
through conventional screening devices. 

All programs do not use the same reading assessment tool. In some cases, 
potential participants are required to take a test of approximately three hours in 
length when shorter instruments of equal screening ability are available. Many 
students indicated that they almost left the program when required to take such a 
long test when enrolling in the program. 



With a myriad of 
problems facing them, 
students often must 
overcome multiple 
barriers to participate 
in the program. 



Problems with the program. There is some inconsistency in who is allowed 
to attend classes. In some sites, if the person has been initially, but unofficially, 
declared eligible, then he or she is allowed to begin attending classes. However, 
at other sites a person cannot participate until the "official" docimients certifying 
that she or he is eligible have arrived. 

Students are not steady in their attendance. With a myriad of problems fac- 
ing them, students often must overcome multiple barriers to participate in the 
program. 

Sometimes the students* goals are higher than their ability to attain them. It is 
not uncommon for participants to believe they can complete the program in a few 
weeks. However, based upon the assessment results, many months or even years 
may be required before they will be prepared to successfully enter the workforce 
or earn their GED certificate. They begin comparing themselves to another fami- 
ly member or a friend who made faster progress, and thus may become so dis- 
couraged that they leave the program. 

The short-term funding is discouraging to local program staff. The start-up, 
stop, start-up-again nature of the funding causes concern for both participants and 
staff, particularly since so much time is required for the eligibility process. The 
inconsistent, undependable funding sources create stress in all aspects of the pro- 
grams. 



Positive Factors. In some programs, several agencies work together to han- 
dle the needed documentation as easily as possible. For example, in El Paso, the 
Department of Human Services (DHS) will FAX a copy of an appUcanfs food 
stamp or welfare data to the PIC for eligibility purposes, saving the applicant the 
time and trouble of going to the DHS office. 
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Some program staff have developed ways to somewhat simplify the eligibili- 
ty process . In Waco, staff have developed a prescreening device of about ten 
questions which, when answered, indicate if the individual may be eligible. If so, 
then the process begins for that person. This saves effort when the individual 
would not have been eligible after going through the entire eligibility process. 

Staff who are bilingual seem to be available at almost every site for eligibili- 
ty activities. There seemed to be much sensitivity to the need for bilingual and 
bicultural staff being available wherever the intake process was being conducted. 

In many programs, only certain individuals woi1c with the screening process. 
Thus, they usually know which documents will be difficult to obtain and they can 
assess the applicant accordingly. In addition, those persons work closely with the 
partner staff if they are involved in assisting the applicant with the eligibility pro- 
cess, and they remain someone who can be contacted when problems arise in the 
future. 

Although much time and effon are required, staff in several programs be- 
come actively involved in assisting applicants with the eligibility process. 
Whether going to the home or to another agency, many program staff go beyond 
what is normally expected to assist in the process. In some cases, they pay the 
fees for the documents when the applicant cannot afford them. This shows genu- 
ine concern for those who are in need of the program. In addition, staff go to the 
partner site to conduct the eligibility activities when the applicant cannot go to 
the JTPA site. 



Many staff go beyond 
what is expected. 



Participant Assessment 



In many instances, the first contact of a prospective participant with a pro- 
gram is crucial. The initial impression may be motivating and may encourage 
someone to enroll in a program, but it may also be a deterrent. Many of the pro- 
spective participants have experienced educational failure in one sense or anoth- 
er earlier in their lives and now fear educational settings. They are also nervous 
about taking tests. For many participants, however, the first contact with the pro- 
gram is an assessment that might be a dramatic experience, even somewhat 
frightening. 

Participant assessment seems to create some problems. More than ten differ- 
ent assessment instruments are currently in use, the most common being the Test 
of Adult Basic Education (TABE). Other assessment instruments, such as the 
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The assessment proce- 
dure appears to he a 
major concern of many 
program directors and 
staff members. 



Woodcock-Johnson, the ABLE» the Job Corps Test, the FRI, and the Berganse, 
are also used. The concerns mentioned most often either relate to the administra- 
tion of the tests or to the suitability and reliability of the tests. 

The administration of certain assessment tests requires the assistance of pro- 
fessionally trained people, such as diagnosticians. For some programs that use 
these types of tests, the availability of diagnosticians caused problems, A few of 
the other instruments in use require initial training for the test administrator 
which is often lacking. Several assessment instruments were reported to be 
lengthy and time consuming. The fact that certain instruments do not detect spe- 
cific problems, such as dyslexia or ether learning disabilities, seems to be an ad- 
ditional concern. 

Other comments referred to the suitability and reliability of assessment in- 
struments. Some instruments in use do not assess reading levels below a certain 
grade level; therefore, participants reading at a very low level must be assessed a 
second time with another instrument. In certain instances, tutors felt a need to re- 
assess participants although they had been assessed during the admissions pro- 
cess. This raises questions about the accuracy of certain instruments while creat- 
ing even more anxiety for the participants. 

The assessment procedure appears to be a major concern of many program 
directors and staff members. Most staff members wanted more information 
about ways to properly assess new students. 

An alternative to the traditional ongoing assessment methods to monitor par- 
ticipant's progress in the program is a blind assessment This kind of ongoing as- 
sessment is only possible at sites that are equipped with computers. The comput- 
er monitors and evaluates student's progress automatically. The tutor can recall 
information about a participant's progress at any time, which allows him or her to 
provide the participant with additional exercises in the areas of weakness. This 
procedure creates a low-anxiety environment for the participants. 

Another option for on-going assessment is a student portfolio. However, 
rather than one single approach or a single test for the evaluation of participants' 
progress, a combination is probably the best approach, depending upon the skills 
of the program staff. Furthermore, it is essential for people involved in the as- 
sessment procedure at any stage to be properly trained. Professionally adminis- 
tered assessment instruments facilitate the assessment procedure, lower partici- 
pants' anxiety level, and lead to more accurate and reliable test results. 
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Implementing Instruction 



Many of the tutors interviewed were trained in and currently work with the 
Laubach materials. The majority of the tutors reported that the needs of the par- 
ticipants are so diverse that they cannot be addressed appropriately with the use 
of one single workbook series* Therefore, many tutors have developed supple- 
mentary teaching materials to try to meet participants' needs more effectively and 
accurately. Many tutors try to develop materials that are tailored to each partici- 
pant's life situation. Their goal is to make the instructional content applicable to 
the student's life situation. 

Many of the participants have experienced failure in earlier educational ef- 
forts or in their personal lives. Initially* they have a very low self-concept. This 
is another challenge for the tutor. Not only are instructional skills a necessity but 
good interpersonal skills as well as communication skills are equally important to 
enhance participants' self-esteem. 

The tutor must be a professional who effectively delivers information. And 
the tutor should also be a caring and supportive person who motivates and en- 
courages the participant. Through the interaction with the participant, the tutor 
must discover what works for the individual and offer instructional material and 
support according to the immediate learner needs. 

The use of technology is still gaining popularity in educational settings. The 
majority of the sites have computer labs. However, computers must be property 
integrated into the entire teaching process to utilize their full potential. Hence, 
the integration of technology is another challenge with which some tutors must 
contend. 



Many tutors have 
developed supplement' 
tary teaching materials 
to try to meet partici- 
pants^ needs more 
effectively. 



Participant Attitudes Towards Learning 

The participants are aware that being able to read and write is important. 
They are convinced that having these skills will help them to become employed 
and to improve their lives. Many participants who only meet with their tutors 
twice a week would like to meet more often. Also, participants who had access 
to computers wished to meet more often and for longer times. Some indicated 
that they enjoy computer-assisted instruction to the extent that it was difficult to 
leave once their learning period was over. 
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Most participants have a precise idea of what they want to achieve in the pro- 
gram. They work hard toward their goal and seem to do everything in order to 
attend classes. The statement, "anything can be done if you really want to," was 
mentioned many times. Once participants had been in the program for a while 
and noticed progress, excitement seemed to have replaced their initial insecurity. 
One instructor described "one lady [who] walks about ten blocks [to class] ... and 
she has been here waiting on me in the mornings in the cold and snow... so you 
know, she wants to come." 

Impacting Student Lives 

Panicipanis are impacted in many important ways. Not only are they thank- 
ful and appreciative for the guidance and support from the staff, they are also be- 
ginning to become less dependent on others and are discovering better ways to 
express themselves. Often this was the "first thing they had ever finished." They 
"Anything can be done learning to operate within the educational system, and are beginning to view 

if you really want to. " authority figures, for example, teachers and administrators, as friends. 
^^^^^^^^^^^^ Some reported that they could now share in the reading process with their 

children. Many can help their children with homework assignments for the first 
time. One participant even mentioned that she now enjoys visiting with her 
child's teacher (without feeling intimidated or frightened) to obtain feedback 
about the child's performance. These accomplishments give students a great 
sense of satisfaction and pride. 

Most of the students' objectives are to find jobs. They can see doors of op- 
portunity opening once they increase their education. Many aspire to go on to 
college once they master basic skills and obtain the GED certificate. 

Other indirect benefits reported by students had to do with the personal im- 
pact these programs have had on them. Students expressed increases in self-con- 
fidence and a sense of accomplishment experienced from the ability to read for 
the first time in their lives. One tutor added, "they are more self-reliant, they're 
sure of themselves. They show more pride in what they*re doing.... Tve seen 
people just burst out because they can read and do math ... their independence 
grows by leaps and bounds." 

One success story was conveyed by a program director who provided an ex- 
cclleni example of the impact experienced by one participant. 
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I had a young man come in with matted and bushy hair. He had on dirty 
clothes and he looked like he hadn't had a bath. He came in initially for food 
because we have a pantry in the back, I asked him to fill in this application 
for food. "I can't read," he said. I asked, "May I talk to you about that?" He 
said, "Okay". So I scheduled him forthe ABLE test, and he went over there 
and took it and qualified. He was on food stamps. The next two times he 
came back in, I noticed a slight difference. Tt.z third time he came in, there 
was hope in his eyes. It was just unbelievable. And he has steadUy cleaned 
up his act. I have obtained glasses for him through the Lion's Qub and he 
has gotten a hair cut. He shaves and wears clean clothes now. It's just 
amazing to see. 



Students expressed 
increases in self^ 
confidence and a sense 
of accomplishment 
experienced from the 
ability to read for the 
first time in their lives. 



Decisions To Leave 

Students' feelings about the program sometimes influence their decision to 
continue. Some feel they are not getting enough attention or at least are not get- 
ting what they expected to get from the program. Many students started with un- 
realistic expectations and often feel frustrated because they are not making the 
progress they desire. As one tutor commented, "Some students think, oh this is 
gonna be a breeze and they get here and they find out that it does take some work 
and they just don't want to do it." And then there are others who simply leave be- 
cause they feel they can manage on the little amount of education they already 
possess or have acquired in the program. 

In most cases, however, the reasons students leave the program have less to 
do with the internal activities of the program and more to do with external fac- 
tors. For instance, they have too many other priorities that conflict with their ed- 
ucational needs. As one staff member pointed out, "It's a big effort on their part 
to take the time to come up here when they have so many other responsibilities." 

In some cases, participants leave the program because they have moved out 
of the area. Others, who are continually plagued with recurrent obstacles, for ex- 
ample, transportation, child care, and jealous spouses, may soon become discour- 
aged and quit. 

Suggestions For Change 



Based on many of the factors discussed, the partners, program directors, staff 
members, instructors, and participants offered their own suggestions for change. 
Some suggestions are already being implemented while others are being consid- 
ered for the future. 
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Several people suggest- 
ed continuous, year- 
round funding and a 
majority recommended 
that a program be 
funded for at least 
two years. 



Many offered suggestions for changes in the JTPA process. Even though 
JTPA is a federally mandated program, there are surely other states who are ex- 
periencing some of the same concerns as those that are being expressed in Texas. 
Perhaps collectively something can be done to improve this bureaucratically en- 
tangled system. 

Due to the amount of paperwork required for funding, it was suggested that 
attempts should be made to decrease redundancy whenever possible. Several 
people suggested continuous, year-round funding and a majority recommended 
that a program be funded for at least two years. The staff felt they could attend to 
the needs of the clients better if they weren't constantly consumed with the bar- 
rage of paperwork and concerns for funding. 

Those interviewed offered several good suggestions for improving partner in- 
teraction in the future. One excellent suggestion provided by a program director 
would not only improve partner interaction but would enhance the service to the 
client as well, "We would like to set up a referral system so that a client can start 
at point A and work all the way through to point Z, thus streamlining everything 
through all the agencies.... It just seems like the process would be so much sim- 
pler and would save tax dollars." 

The goal is to improve teamwork and communication between partners by 
building a sound network as a foundation. Those with the foundation in place 
were interested in expanding the partnership to include more support from other 
agencies. 

Everyone wanted to operate the most effective program possible but many 
had problems related to the intake process. Some either wanted to change the 
testing instruments they currently use or hire testing consultants to assist them 
with an overly complex process. 

Some felt the use of a student portfolio would be the best way to assess stu- 
dent perfomiance over the xtrm of the contract. Others wanted to assess the stu- 
dents at the outset for learning disabilities and vision problems which could be 
overcome with special diagnoses if they were detected early. 

Almost everyone wanted to offer literacy classes more days in the week, 
more evenings in the week, and on weekends. Limited resources were mentioned 
most often as obstacles that stood in their way. Everyone was interested in over- 
coming transportation barriers that prevented participants from being served. 
Whether urban or rural, transportation was one of the greatest prevailing needs. 

Teachers were interested in purchasing additional and different kinds of ma- 
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terials so students could be exposed to a greater variety. There was a growing in- 
terest in computer technology. Those who were already using the technology 
wished to incorporate more of it into their programs, while those who were not 
currently using it wanted to add it. 

The staff hoped to provide better service to the participants in the future. 
They expressed the need to provide: more one-on-one instruction, more flexibili- 
ty, more individualized experiential training, and to improve client contact. 

Methods that many programs wanted to pursue in the future included the ad- 
dition of: ESL programs, whole language learning, family literacy, and comput- 
er-assisted instruction. 

There were three other suggestions that deserve special attention because 
they concentrate on the unique needs of the participants. The first suggestion 
was to develop support sessions for participants. One tutor commented, "A lot of 
these people really need the help of knowing what somebody else is going 
through-somebody who is in their same kind of situation." 

The second suggestion involved the creation of video-taped educational seg- 
ments, for example, how to fill out a job application or how to obtain a driver's 
license. Adult learners like instruction to be applicable to real life situations and 
low-level, literate adults are no exception. Some participants could also learn 
more rapidly from videos. 

The final suggestion was the creation of a mobile literacy unit to overcome 
the barriers of transportation, especially for participants in remote, rural areas. 
While a mobile literacy unit might not be the answer for everyone, similar ar- 
rangements may be worthy of consideration. 
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GRANT FUND DECLINERS 

Bill Whiiloe. a representative for the executive direaor of the Houston Job 
Training Partnership Council, and Fritz Taylor, the JTPA director for Nortex Re- 
gional Planning Commission in Wichita Falls, were interviewed separately to de- 
termine why they each declined the Texas Literacy Council's Partnerships Grant 
award of $61,745 in proposal year 1989, 

Bill Whitloe explained that the Houston Job Training Partnership Council de- 
cided to decline the award due to the fact that they were able to fund the partner- 
ship through an existing grant program. This enabled them to reduce "additional 
administrative and training costs." 

Fritz Taylor, at Nortex Regional Planning Commission, reported that they al- 
ready had existing JTPA funds available for literacy efforts and felt other pro- 
grams in the state could perhaps benefit from the funds if they declined the 
award. Both of these partnerships had prior experience in obtaining JTPA grant 
funds and in providing literacy services in their Service Delivery Areas. 

Tom Dressier is the Director of Employment and Training at the Panhandle 
Job Training Partnership (PJTP) in AmariUo. He was interviewed to determine 
why PJTP declined funds in proposal year 1990. Mr. Dressier reponed that the 
proposal was a "lasi minute, hurry up deal." He further commented that a repre- 
sentative from AmariUo College wrote the proposal alone and then discovered at 
the last minute that the funds would have to be filtered through a Service Deliv- 
ery Area (SDA). The proposal author from AmariUo CoUege then approached 
Mr. Dressier for PJTP assistance. Mr. PJTP agreed to represent the CoUege and 
together they submitted the proposal for approval at the state level. The proposal 
came back approved but was subject to final negotiations. Because the final ne- 
gotiations were "too extensive," the Panhandle Job Training Partnership and 
AmariUo College jointly decided to withdraw the proposal rather than to make 
the necessary adjustments. 

Mr. Dressier felt the state's practice of sending RFPs to entities other than 
SDAs should be reevaluated as many RFP recipients often do not realize that 
funds must be channeled through a SDA. He commented that this has caused 
some confusion and frustration for his agency in the past. 

Finally, Mr. Dressier has since been able to form a Uteracy partnership in 
AmariUo and is requesting Texas Literacy Council's Partnerships Grant funds for 
proposal year 1992. If the proposal is approved, this wiU be the first time JTPA 
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funds have been used for literacy efforts in this region. 

Alice Sell, who represented the Literacy Council in Levelland, was also in- 
terviewed to determine why the partnership in that SDA decided to decline grant 
funds in proposal year 1990. The partnership had originally applied for $75,000 
and received approval for $61,000. Even so, the cutback was not the determining 
factor in the decision to decline funds. It was because the partners had no prior 
experience in working together and because they had a limited time frame to pre- 
pare for the program. They therefore jointly decided to decline the funds and 
wait a year until they felt they could implement a quality program. 

Finally, Janet White, the director of the Travis County Adult Literacy Coun- 
cil u\ Austin, was interviewed to determine why the partners in that SDA had de- 
cided to decline a grant award in proposal year 1990. This was the only program 
where the declination of funds was caused by a strained partner relationship. 

The program in Travis County consisted of three partners. Included were 
the Private Industr>' Council, the literacy council, and a private entity, the Ameri- 
can Institute for Learning. Ms. White received only a small portion of total part- 
nership monies in previous years even though she felt the literacy council had 
contributed the most resources. Because she and the members of her board felt 
the missions of the partners were in conflict, the literacy council therefore de- 
cided to terminate the partnership in 1990. 

When asked why she felt the partnership was unsuccessful, Ms. White indi- 
cated three reasons related to the partnership and two related to the JTPA pro- 
cess. In regard to the partnership, she felt that the cost per student was too high, 
the panncr*s goals were not synchronized, and finally all partners were not equal- 
ly represented in the decision-making. Ms. White also expressed concerns about 
the JTPA process. She felt that the eligibility requirements for students were too 
stringent, and the participant assessment requirements were too stressful and in- 
timidating for the students. 

Ms. White did offer recommendations for change to improve the process. 
First she felt that because the process was too political, the monies should not be 
required to flow through a PIC. Second, she felt that improvements needed to be 
made in the assessment process because she felt that students are not able to con- 
form to the standards set by the JTPA grant program. Finally, she felt the funds 
should be easier to administer so that the partners could concentrate their efforts 
on improving literacy in the state. 

Ms. White commented that she did not plan on seeking JTPA funds in the fu- 

be 
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lure if she had to use a PIC as a "pass through" for funds because she felt they 
have "a different philosophy on how the money should be spent." She felt the lit- 
eracy councirs interests were "client-centered," while the other partners saw the 
clients as "incidental to the program." 

Finally, she felt the money would be "extremely beneficial to her organiza- 
tion but there were too many deterrents" that inhibited her success and the suc- 
cess of her staff in serving those who needed help the most. 



Partnering for Literacy 



Model Of An Effective Partnership 

Program 

In reviewing the fifteen programs in this study, certain elements of effective 
functioning could be identified. While no single program evidenced all of these 
elements, most had various combinations of these factors that contributed to their 
effectiveness. Each element was present in at least one of the programs studied. 
When considered together, we believe these elements suggest a model of an ef- 
fective partnership program. 

The model consists of two categories. The first presents those elements 
which are foundational to program functioning, what we call the overarching 
characteristics of effectiveness. The second category contains specific activities 
within the programs. 

OVERARCHING CHARACTERISTICS 

• Good communication among partners, administrators, and staff 

• Collaborative decision-making. 

• Frequent feedback and evaluation related to the functioning of all aspects of 
the program. 

• On-going recruitment and referral of potential students by all the parmers. 

• An attitude among partners that is characterized by "How can we help each 
oLher?" instead of "What*s in this for me?" 

• A flexible and adaptive approach in teaching. 

• An experienced staff. 

• Continuity of programing. 

• Commiunent to the success of students as individuals. 

SPECIFIC ACTIVITIES 

Initial Development 

• A core of partners who have worked together in other contexts and who 
therefore have trust and confidence in each other. 

• The local literacy council playing a central role. 
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• Business and industry actively involved, particularly in curriculum 
development. 

• Professional educators included among the partners. 

• Social service agencies involved. 

• Clear delineation of partner roles and responsibilities, with those responsibil- 
ities including but extending beyond referral of potential students. 

Administration 

• Regular meetings of partners (ideally monthly) with shared decision-making. 

• Frequent informal contact among partners and among staff, in addition to the 
formal meetings. 

• Staff committed to going **the extra mile" to serve participants. This is par- 
ticularly important during the eligibility process and for student follow-up. 

• Networking with other community agencies. 

• Sharing of resources. 

Program Design and Delivery 

• Provide easy access for intake to participants. 

• Provision of a positive learning environment. 

• Use of computers in the learning activities. 

• Flexible schedules. 

• Curriculum focused on needs of target population. 

• Provision for childcare and transportation. 
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Recommendations 



From the infonnaiion acquired in this evaluation study, certain recommenda- 
tions for program activities have been developed. These are not intended to indi- 
cate that the partnership programs are not functioning well. In fact, with the myr- 
iad of obstacles which have been identified previously, the evaluation project 
staff is impressed with the number of good things that are happening with the 
adult participants through the dedicated staff at the Texas Literacy Council and 
the partnership organization staff members in the local communities. These are 
intended for program improvement, realizing that not all can be achieved imme- 
diately, but hopefully, they can become a guidepost for program planning and de- 
velopment in the future. The recommendations are presented in four major cate- 
gories with related sub-categories included. 

GRANT APPLICATION PROCESS 

To improve the grant application process, the Texas Literacy Council should: 

• Publicize the announcementCs) of the Request for Proposal (RFP) to all 
literacy councils with the assistance of the PIC. In some cases, it is the literacy 
council which initiates the partnership grant application and council staff must 
realize that support of the PIC is crucial if the program is to exist. This realiza- 
tion is not always apparent to literacy councils as indicated in some of the inter- 
views. 

• Provide more lead time between issuing the RPT and the required dead- 
line for submitting the proposal. This is especially important for literacy councils 
which arc applying for the first time and must initiate all procedures for partner- 
ing with organizations in the community. 

• Initiate a bidders workshop for individuals who are interested in applying 
for a partnership grant. This would expedite the proposal review process through 
educating applicants in the specific requirements and/or changes in effect for 
making application. In addition, this should improve the overall quality of the 
proposals. 
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TRAINING 

When a partnership grant is awarded, a requirement of the funding should in- 
clude participation of the partnership staff in training, provided by the Texas Lit- 
eracy Council, as indicSaied below. 

State-wide, or Reponal training . This should be offered very soon after 
grants are awarded. Content should include: 

• Participant eligibility-rules and regulations for certification; 

• Assessment-goals, needs, and academic abilities; 

• Adult learners-why they participate and why they drop out; 

• Cultural awareness-values and attitudes of participants; 

• Resources-human and maverial resources available for programs; 

• Teaching strategies-^nethods appropriate for adult learners; and 

• Networking-strategies for implementation. 

Successful activities already in progress would also be shared among the 
grant participants during the training. Plans for follow-up technical assistance 
would also be fomiulated and shared by TLC staff. 

PARTNERSHIP EFFECTIVENESS 

Among the various activities which could improve the effectiveness of the 
partnerships, assuming that staff are knowledgeable in how to implement them, 
arc: 

Sharing Resources 

There are not sufficient resources within any one organization to meet all of 
the program needs. However, when several agencies combine their resources, 
much more can be accomplished. One suggested practice when a program is 
newly funded (or when new partners join a program) is for all partners to not 
only describe who they are and what they do, but to actually train the other part- 
ners in the kinds of services they can provide. Communication from all staff re- 
lated to the program is essential for effectively serving the student clientele. 
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Networking 

This activity should be developed both within the program, among the part- 
ners, and between and among the various programs across the state. Within a 
program, networking can be achieved through regular meetings of all partners 
(monthly seems to work well in some programs), having training programs for 
designated problem areas, and carefully planned public relations events which in- 
form the community about the program, emphasizing successes. A successful 
program may generate interest from other community organizations who want to 
become a part of this successful endeavor. 

Networking among programs throughout the state can produce several bene- 
fits for a local program. This could (a) establish a system for sustaining the dis- 
semination of valuable information among the partnership programs on a regular 
basis, (b) develop a means for staff to share problem -solving techniques, and (c) 
enable the TLC staff to monitor programs more easily and to increase program 
quality through regular technical assistance activities, for example, newsletter, 
bulletins, etc. 

Cooperative Planning 

One of the issues which seemed to be of concern to partners in some pro- 
grams was not being involved in the actual planning efforts for the partnership. 
After the initial meeting has been called to determine which agencies and organi- 
zations arc inicrcstcd in participating, the planning and organizing activities are 
conducted by one or only a few of the partners, leaving the others outside the de- 
cision-making role. Therefore, roles and responsibilities of all partners are never 
understood, and cooperation is never attained, reducing the effectiveness of the 
program. 

Communication 

In some programs, panners communicate regularly, either through scheduled 
meetings or by telephone. They all know the progress of the program, what 
problems have been delected, and what is being done to solve them. In other 
programs, partners rarely communicate and not only are they uninformed about 
critical aspects of the program, there is often some suspicion and mistrust about 
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the other partners. When communication occurs, students are better served and 
fewer "fall through the cracks." whether in the eligibility process or from irregu- 
lar class attendance and related activities. As indicated previously, adult students 
in these programs need to discern a caring attitude toward them, and communica- 
tions from all staff related to the program is essential for effectively serving the 
student clientele. 

PROGRAM EFFECTIVENESS 

Intake/Eligibility 

Since this aspect of the program seems to provide the most problems, the 
TLC, in cooperation with the staff at the PICs. should provide partnership staff 
with the following capabilities: 

• Knowledge of the requirements for participant eligibility. Even though 
all partners don't play a major role in the intake process, some potential students 
become confused when they receive conflicting infonmation about eligibility re- 
quirements. 

Skills for assisting potential participants to learn which documents are re- 
quired for program eligibility. Many cannot read in any language well enough to 
even recognize an important document, and some do not pursue entering a pro- 
gram because of this difficulty. 

• Competency to work with otlier agencies to develop collaborative efforts 
in processing paperwork for certifying eligibility. Too many potential partici- 
pants lose their motivation for enrolling because of the time and effort required to 
become eligible for the program. This includes follow-up activities to assure that 
eligible persons are enrolled as soon as possible after their initial contact with 
program staff 

Assessment 

The TLC staff should provide evaluations of available instruments for initial 
student assessment and from those evaluations recommend a limited number 
which incorporate the following features: 

• Some evidence that it is valid and reliable; 

• Easy to administer, 
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• Can be completed by participants in less than one hour, 

• Useful for local programs, whether grade-level or competency-based; 
and 

• Is as nonthreatening as possible. 

In addition, some provision should be made to detect the possibility of learn- 
ing disabilities among the adult participants. When indicated by regular assess- 
ment procedures, a second assessment may be necessary to ensure proper assign- 
ment of teaching strategies and materials for learning disabled participants. 
Whatever and whenever assessment instruments are used, the features indicated 
above should be of prime importance in their selection. 

Content Delivery 

All local program staff should attain knowledge in the following areas. Al- 
though some of the items found below have been mentioned previously, all are of 
primar)' imponance in the delivery of instructional services to the adult partici- 
pants. Since many of the local program staff have not had professional prepara- 
tion in adult education, the acquisition of the recommended knowledge would en- 
hance their success in working with the program participants. 

• The adult learner . Adults are different from children, both in their moti- 
vations for attending classes and in their learning styles. They must be treated 
with respect for the knowledge and skills they have acquired. In addition, they 
must be assisted in setting realistic goals, both about their capabilities to acquire 
academic skills within a certain time, and about the future use of the skills they 
intend to acquire. 

• Selection and development of teaching materials . This cannot be left for 
vendors* decisions. If appropriate materials arc not available for purchase, staff 
must learn to adapt or develop those materials which are most appropriate for 
meeting the students' needs. This also includes infomiation about computers and 
their use in the classroom. The data in this study indicate that the adult partici- 
pants who were inU'oduced to computers were quite positive about them in their 
learning activities. 

• Needs assessment . Adults have different goals for their learning, includ- 
ing achieving basic reading and writing skills, acquiring a job, or furthering their 
education beyond the GED certificate. Sometimes the program staff assume that 
all participants have the same goals and teach accordingly. Then they wonder 
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why students leave. 

• Teaching strateg ies. Even in one-to-one tutoring, a variety of teaching 
activities works best, as indicated by the training materials of the volunteer liter- 
acy organizations and verified by research in adult education. Motivation to par- 
ticipate is enhanced through the variety of teaching and learning activities pro- 
vided. 

• Cultural awareness . The cultural backgrounds of the students usually dif- 
fer from those of the staff in most literacy programs, and the partnership pro- 
grams are no different. However, this poses no problem when the staff are not 
only aware of those differences but also sensitive as to how they can impaa the 
learning process. Trust and dignity were two concepts which appeared to be very 
important to the adults enrolled in the partnership programs. 

• Location and availability of resources . Many of the teachers and tutors 
desired infonnation about other resources available for their use. They were un- 
aware of resources outside the program, many of which could be attained within 
their own communities. As costs increase and budgets become tighter, this 
knowledge will become more valuable to partnership programs. 

Funding 

This concept is an issue in almost any educational program, especially when 
discussing the need for additional funding. Although that may also apply here, 
the real issue is not so much additional funding as continuous funding. The TLC 
staff must seek ways to develop some kind of continuous funding of the partner- 
ship programs from year-to-year. The discontinuity of funding creates the fol- 
lowing problems which were voiced in virtually every program which has been 
in existence for more tlian one year: 

• More difficuh to obtain program objectives; 

• Loss of experienced staff who seek employment in more stable environ- 
ments; 

• Loss of participants and their interest and motivation for attending; 

• Loss of potential space which is given to other programs that have con- 
tinuous operations; and 

• Loss of valuable time for the participants in reaching their goals. 
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Technical Assistance . Partners sometimes said they fell "lonely," especially 
when needing information and assistance in regard to program issues and prob- 
lems. Suggestions to assist those staff include: 

• The TLC staff should endeavor to provide technical assistance following 
the initial training of program staff (recommended previously). This can be ac- 
complished through the TLC staff members themselves, or through the use of 
other agencies, e.g.. Laubach Literacy International, Literacy Volunteers of 
America, or other organizations. 

Staff from programs with experience in the partnership program should 
be assigned as "mentors" to staff in newly funded programs. Thus, valuable ex- 
perience can be shared and the opportunity for assistance in problem-solving 
would also benefit new program staff. This may also foster a feeling of mutual 
supfX)rt among all of the parmership programs. 

• The business community should be included in technical assistance ac- 
tivities. This could range from determining the employment needs of the private 
sector, including literacy competencies needed by employees, to assistance in 
program dclivcr>\ for example, employees serving as tutors, furnishing space for 
the program, and other related involvement. The main factor is that the business 
community will become aware of the program and what it can offer them in 
ternis of prospective employees possessing basic skills, positive attitudes, and a 
desire for work. 

We really arc "all in this together," The ftiture of our state and nation will be 
greatly influenced by the literacy and skills possessed by our population. The 
partnership grants program is only one effort of many to enhance the learning 
and potential employment abilities of the undereducated adult in Texas, but it is 
It is gratifying that so many dedicated people are involved in trying to make 
this program successful in serving those who are most in need. 
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Appendix 

INTERVIEW SCHEDULES 
Partner 

1 . How long has the JTPA literacy program been in existence? 

2. How did the JTPAliteracy program get started? 

3. Who initiated the program and what role(s) did they play? 

4. What factors were working in your favor when the program originated? 

5. WTsat obstacles were working against you in the beginning? 

6. E>escribc how the partners function together now, 

7. What arc their individual responsibilities? 

8. Do you feci that partners function effectively together? 

9. VvTiat changes would you suggest to increase their effectiveness? 

1 0. How are participants recruited? 

1 1 . What resources do you get from the Private Industry Council? 

12. What resources or services do you offer to the Private Industry Council? 

1 3. How did you find out about the JTPA literacy grant funds? 

14. Can you briefly describe the organization structure for the JTPA literacy grant project? 



r O * 68 

ERLC 



Partnering for Literacy 
Project Director 



1. What is your title? 

2. Who do you work foi? 

3. What percentage of your time is spent working on this JTPA literacy project? 

4. How is your paid staff recruited? 

5. What qualifications do you look for? 

6. Who administers and/or oversees the JTPA g. ant funds for literacy programs in this Service 
Delivery Area? 

7. How does your Service Delivery Area hear about the JTPA grant funds for literacy programs? 

8. Please describe the organization structure of this JTPA literacy grant project. 

9. How long has the JTPA literacy program been in existence in your Service Delivery Area? 

10. How did the program get started? 

1 1 . Who initiated the program and what role(s) did they play? 

12. WTiat factors were working in your favor when the program originated? 

13. WTiat obstacles did you have to overcome in the beginning? 

14. (For projects in the 2nd or 3rd year only) How has your program changed over the past year 
or two? 

15. In your proposals you identify several objectives you plan to accomplish this year. How are 
you evaluating your success in meeting the stated objectives? 

16. WTiat factors make your program a success? 

17. What factors hinder your program's success? 

18. If you had no limitations, what changes would you make in the program? 

19. WTiat future plans do you have for the program? 

20. Describe how the panners function together. W^at are their individual responsibilities? 

21 . Do you feel that partners function effectively together? What changes would you suggest to 
increase effectiveness? 

22. Arc there any other agreements used among partners besides the proposal contract? 

23. Are grant funds divided among partners? Who makes this decision? How is the decision 
reached? 

24. How are participants recruited? 

25. How do you determine JTPA eligibility for participants? 

26. VkTio is involved in the intake process? 

27. What problems arise during the intake process? 

28. Approximately how long does the intake process take for each participant? 

29. What problems delay the process? 

30. What pretest instrument is used to determine an applicant's reading level? 

31. What kind of posttest is used to determine the increase in the participant's reading level? 

32. What factors influence participants who drop out of the program? 

33. are your completion rates for participants? 

34. VvTiat kind of participant follow-up do you do? 
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Instructor/Tutor 

1 . How long have you been an instructor/tutor in the JTPA literacy program? 

2. Have you taught in any other programs? 

3. If you have taught in other programs, how do you feel about this program as compared to others? 

4. Describe how this program works. 

5. What materials do you use? 

6. VvTio selects the materials used in the program? 

7. Have you developed any of your own materials? 

8. Which materials have proven to be especially successful? 

9. What teaching methods do you find woik the best? 

10. Describe the changes you see in participants as they go through the program. 

1 1. How do you think tlie participants feel about the program? 

1 2. Why do you think some participants drop out of the program? 

1 3. Have you interacted with the other partners in this program? (selection, communication, 
training) 

14. If you have interacted with other partners, how has that woiked? 

15. WTiat kind of interaction would you like to see? 

1 6. What kind of support do the instructorsAutors get? 

1 7. What kind of interaction occurs among the instructors/tutors? 

18. If you were in charge and had all the money you needed, what would you change to make the 
program more effective? 

19. How have you been trained as a literacy tutor or teacher? (LVA or LAUBACH) 

20. Was that training adequate? 
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Current Student • 



1. 


How did you first hear about the program? 




2, 


When did you first hear about the program? 




3. 


What were you told about the program? 




4. 


Were there any people who influenced your decision to get involved? . 




5. 


V^Tiat were your reasons for deciding to participate? 


• 


6. 


What did you hope to gain from the program? 




7. 


Think back to the first day in class and describe what it was like. 




8. 


How did you feel about being in the program during that first class? 




9. 


How long have you been in the program? 


• 


10. 


Are your feelings about the program any different now? Explain. 




11. 


How would you describe the program to someone who has never heard of it? 




12. 


WTiat do you like most about the program? 




13. 


What do you like least about the program? 


• 


14. 


Is the location of the program convenient? 




15. 


Is the program offered at a convenient time for you? (day/year) 




16. 


Are there factors that make it hard for you to get to class? 




17. 


How do your (family/friends) feel about your participation in the program? 




18. 


How has your life changed as a result of the program? 




19. 


Have there been any problems with your being in the program? 




20. 


How do you think the program will better your life? 


• 


21. 


What advice would you give to someone who is just starting the program? 




22. 


Suppose you were the person in charge of this program and you had all the money you needed, 
what changes would you make? 




23. 


Would you join the program if you had it to do all over again? Explain. 




24. 


Would you encourage others to participate? If so, what would you say to them? 




25. 


Based on your experience in this program, how would you feel about participating in other 
educational programs in the ftiture? 




26. 


Finally, what do you hope you will be doing five years from now? Has the program had any 
impact on how you think about your future? 


• 
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Graduate 



1 . How did you first hear about the program? 

2. When did you first hear about the program? 

3. What were you told about the program? 

4. Were there any people who influenced your decision to get involved? 

5. What were your reasons for deciding to participate? 

6. What did you hope to gain from the program? 

7. Think back to the first day in class and describe what it was like, 

8. How did you feel about being in the program during that first class? 

9. Now that you have completed the program, are your feelings any different? Explain. 

10. How would you describe the program to someone who has never heard of it? 

1 1 . What did you like most about the program? 

12. WTiat did you like least about the program? 

13. Was the location of the program convenient? 

14. Was the program offered at a convenient time for you (day/year)? 

15. Were there factors that made it hard for you to get to class? 

16. How did your (family/friends) feel about your participation in the program? 

1 7. How has your life changed as a result of the program? 

1 8. Were there any problems with your being in the program? 

1 9. How do you think the program will better your life? 

20. What advice would you give to someone who is just starting the program? 

21 . Suppose you were the person in charge of the program and you had all the money you needed, 
what changes would you make? 

22. Would you join the program if you had it to do all over again? Explain. 

23. Would you encourage others to participate? If so, what would say to them? 

24. Based on your experience in this program, how would you feel about participating in other 
educational programs in the future? 

25. Finally, what do you hope you will be doing five years from now? Has the program had any 
impact on howyou think about your future? 
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Student Who Did not Complete the Program 

1 . How long were you in the program? 

2. What were your reasons for deciding to participate? 

3. What were your experiences like in the program? 

4. What did you like most about the program? 

5. What did you like least about the program? 

6. How did your family and friends feel about your participation in the program? 

7. WTial were your reasons for leaving the program? Explain. 

8. Is there any way the program could be changed to make it work for you? 

9. Would you consider completing the program at a future time? Explain. 

10. Would you consider participating in another educational program like this one in the future? 
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Grant Fund Decliner 

1 . Have you used JTPA grant funds (provided by the Texas Literacy Council) in the past for 
literacy training? 

If yes: 

a. Was the program successful? 

b. In what way was the program successful/unsuccessful? 

c. WTiat contribution did the JTPA literacy grant money make to your overall operating 
budget? 

d. Who were the partners? 

e. Did ihey function effectively together? 

2. What made you decide to apply for JTPA literacy grant funds? 

3. What were the reasons for declining funds after you applied? 

4. Were the partners (sub-contractors) involved in the decision to decline grant funding? 

5. WTiat other funds are available that enable you to operate the literacy program without the use of 
JTPA literacy money? 

6. In your opinion, what changes could be made in the JTPA literacy program to make it function 
more effectively? 

7. Do you plan on seeking JTPA literacy funding in the future? 

8. In your opinion, are there j)eople who are not being served because of the decision to decline 
grant funding? Please explain. 
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